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[Text] A survey of the current status of industrial 
robotics in the USSR and abroad and also analysis of 
some trends of its development is presented. 


The use of robotics today is one of the main methods of increasing the 
volume of the products of industrial production, of increasing their 
quality and, which is especially important, of a flexible response to 
the variable requirements of the market. Industrial robots play a key 
role in the designs of future plants--automated plants--being developed 
today. Robotics has been transformed into a major sector of industry in 
the developed capitalist countries. Such well known corporations as 
Fanuk, Fujitsu (Japan), General Electric and IBM (United States), 
Olivetti (Italy), Volkswagon (West Germany), ASEA (Sweden) and also many 
medium and small enterprises are involved in research, development, 
production and marketing of robotics. More than 700 companies, 
including approximately 400 companies in Japan, 50 companies in the 
United States, and 250 companies in Western Europe, are engaged in 
manufacture of industrial robots (PR) in the overall complexity of 
capitalist countries. A significant part of research in robotics is 
performed at the leading technical universities. Departments on 
robotics have been created, for example, at the Massachusettes Institute 
of Technology, and Carnegie-Mellon and Stanford Universities. The 
research is financed mainly by industrial enterprises, interested in 
introduction of new technology into manufacturing. However, significant 
funds for development of robotics are also allocated from the state 
budget of the leading capitalist governments. All this leads ‘to steady 
growth of both the number of industrial robots used in industry and to 
an increase of the quality characteristics of robotic systems. 

According to data of the French Federation on Robotics, there were 
44,000 industrial robots in Western Europe, 38,000 in the United States, 
and 210,000 in Japan by the end of 1989 [1]. One should bear in mind 








the conditional nature of these figures, related to different 
definitions of industrial robots in different countries. However, the 
trend of development of industrial robots can be established. According 
to forecasts of the early 1980’s, the manufacture and introduction of 
robotic devices should be performed on a considerably greater scale and 
should have a significant influence on their rate of employment in 
industrial production. Thus, according to data of the Institute of 
Robotics of Carnegie-Mellon University, industrial robots should free 7 
million workers from production in the United States. According to the 
forecast of the second half the 1980’s, compiled by the American 
economists V. Leontyev and F. Dachin, no fewer than 2 million workers 
will be freed due to robotics by the year 2000. Other forecasts are 
also subject to correction toward a decrease. This variation of the 
prospects is mainly related to the difficulties in introduction of the 
manufactured product. The new forecasts proceed from the fact that the 
rates of growth of the worldwide capitalist market  * industrial robots 
have stabilized and comprise 15-20 percent annually. A period of 
euphoria has been replaced by a more sober attitude toward the aspects 
of the application of robotics. 


The forecasts concerning the structure of robotic systems and their 
areas of application have been largely confirmed. As one would assume, 
second-generation robots, which have external information sensors that 
permit them to correct their motions to some extent, comprised a 
significant part of the industrial robot stock by the mid-1980’s. These 
are mainly robotic vision systems and force-moment sensitization. The 
main sphere of application of industrial robots still remains machine 
building, primarily, the automotive industry, and electronics and 
electrica! engineering enterprises. However, the demand for robotic 
systems, designed for automation of operations in nonmachine-building 
sectors, has now increased sharply. These are construction, transport, 
the coal-mining industry, light industry and agriculture. According to 
data of the Japanese Association ca Industrial Robots, which conducted 
research on the needs of industry for second-generation industrial 
robots, the main part of these industrial robots in machine building 
should be engaged in assembly operations (20.9 percent). At the same 
time, 32.2 percent of industrial robots are required for automation of 
operations in extreme environments, 8.3 percent are required for 
automation of transport operations, 12.4 percent are required for repair 
and preventive maintenance, and 6.1 percent are required for use in 
emergency situations [2]. 


The output of industrial robots in the USSR during the 12th Five-Year 
Plan should comprise 100,000 units [3], which is double the data for the 
10th Five-Year Plan. Thus, there is the tendency to maintain the high 
rates of growth of the industrial robot stock. Considerable experience 
in robotization of the automotive industry, machine tool building and 
instrument building has been accumulated. A total of 28 percent of 
industrial robots is now involved in welding operations, 30 percent 
service stamping machines and presses, and 22 percent service machine 
tools. The operations are mainly automated due to first-generation 





robots, i.e., rigidly programmed robots, 69 percent of them have cyclic 
control and 28 percent have position control. A total of 3 percent 
comprise robots with contour control that use microprocessors [4]. At 
the same time, this figure now comprises 31 percent for the industrial 
robots used in the West and in Japan. Thus, there is some lag in the 
structure of the industrial robot stock; second-generation robots have 
not yet found broad introduction in industry. One of the causes of this 
is the low reliability of industrial robots, manufactured at some 
enterprises. According to the technical assignment, it usually 
comprises approximately 2,000 hr of mean times between failure, whereas 
this figure is equal to 10,000 for Western industrial robots. In 
practice, the mean times between failure is rarely less. Another 
problem is the high cost of robotics. The cost of loading-transport 
industrial robots now comprises 11,000-15,000 rubles, while that of 
production industrial robots comprises 35,000- 95,000 rubles. The level 
of prices for robotics increases by 30-40 percent annually. Because of 
this, the level of the economic impact of the use of industrial robots 
in the USSR remains very low. In the opinion of industrial workers, 
transition to new management conditions may result in a significant 
decrease of plans for introduction of robotics at enterprises. To avoid 
this, a serious change of the structure of robotic systems manufactured 
by industry toward an increase of second-generation industrial robots, 
improvement of the reliability of industrial robots, and of their 
efficiency are required. Estimates show that the necessary efficiency 
will be achieved with an increase of the number of realistically freed 
workers of three-fivefold per industrial robot. 


The worldwide trend, related to expansion of the traditional sphere of 
application of robotics in the nonmachine-building sector of the 
national economy, has also been manifested in Soviet robotics [5]. This 
direction is of important social significance, since the percentage of 
unskilled heavy manual labor is very high in the USSR, compared to the 
other industrially developed countries. This is primarily true of the 
coal and mining industry, ferrous and nonferrous metallurgy, 
construction, agriculture, and the light and food industry. The 
importance of using robotics in these sectors is determined by the fact 
that a large part of the country’s labor resources is engaged in them, 
while the degree of automation is lower than that in machine building. 
Studies are being conducted intensively in this sector and the first 
models of similar robots are beginning to be introduced in the national 
economy . 


Let us present several] examples in order for the reader to gain an idea 
of the technical capabilities of modern industrial robots [6, 7]. The 
M5030 Hitachi welding robot (Japan) with five degrees of freedom and 
with capacity of 3 kg performs welding at a rate of 2.4 m/min and with 
accuracy of #0.2 mm. The IRB 2000 ASEA industrial arc-welding robot 
(Sweden) with capacity cf 10 kg has a maximum speed of 3 m/s and a 
positioning error of #0.1 mm, and also a contro] system for 12 variables 
simultaneously (6 are related to the robot and 6 are related to external 
devices). The KUKA robot (West Germany) with capacity of 150 kg, which 





has seven degrees of freedom, is used for spot welding in the automotive 
industry. An example of a modern industrial robot for loading machine 
tools and pallets is the IBM 3000 industrial robot with capacity of 

30 kg, with positioning error of 40.4 mm, with a speed of 1.5 m/s, and 
with working zone radius of 1.95 m. Among second-generation robots 
designed for welding, one can note the SCARA AR-i 270 Stenzel (West 
Germany) industrial robot, distinguished by special accuracy, with 
capacity of 2 kg, with speed of 4.1 m/s, and with positioning error of 
+0.05 mm. The Sony Corporation (Japan) has delivered to the market 
two-armed assembly robots with length of the arms of 250 and 350 mn, 
capacity of 1 and 5 kg, respectively, and with speed of 5.3 m/s. 


Intel-8086, Intel-80186, and Motorola 68000 microprocessors are usec as 

the control systems of these robots. Programming is in high-level VAL, 

VAL TI, AL, AML, HELP, JARS, and MSL languages, and also in universal C, 
Fortran, and Basic programming languages. 


The MP-9S and MP-11 (Minavtoprom [I'/SSR Ministry of the Automotive 
Industry]), the RF-202, RF-204, Granat-2.5 and Granat-10 (USSR Ministry 
of the Radio Industry]), Elektronika-NTsTM-0.1 and also the M20P40.01 
industrial robots produced by MSPO [Moscow Union of Consumers Society] 
Krasnyy proletariy among the industrial robots, manufactured in the USSR 
and having characteristics corresponding to the worldwide level can be 
named; a number of robots is manufactured in the USSR by licenses 
purchased from foreign companies, including KUKA and Fanuc. 


The control systems of Soviet industrial robots are implemented on 
16-bit K1810 and K586 microprocessors and one-chip KM1816 computers. 
The main computer is the NTs80-01DN microcomputer, constructed on 
KR1801NM2 microprocessors; K580 microprocessors are used to control the 
drives. A new fourth-generation control system IS.02, which is a 
combination of standardized modules and which is designed for group and 
autonomous position-contour control of manipulators in a flexible 
manufacturing system, has been developed. This system considerably 
exceeds Soviet analogues (MPSU and Sfera-36) in speed, capacity of the 
control program (526 kbytes), the number of digital inputs-outputs and 
reliability. Its mean times between failure is 10,000 hr. 


The tendency toward an increase of the role of the electric drive has 
been noted in the field of industrial robot drives, which has begun to 
be used not only for small- and medium-capacity robots (10-25 kg), but 
for large-capacity industrial robots (160-200 kg), i.e., for industrial 
robots which were earlier constructed on the basis of electrohydraulic 
drives [8]. Electric drives have been developed in the USSR, which are 
not inferior to foreign analogues in their parameters. These are the 
EPB-2 drive with transistor converter and DVU and 2DVU synchronous 
electric motors, and also the Razmer 2M electric drive with transistor 
converter and with asynchronous motors of the AI series. The most 
promising for industrial robots are drives based on contactless electric 
motors (DC, three-phase asynchronous motors), which have a longer 
service life than the DC motors previously used here. Reducerless 
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(“direct action") drives based on high-torque contactless motors must be 
developed to realize high-performance industrial robots, operating at 
speeds up to 10 m/s. These studies are being conducted both in the USSR 
and abroad. The specifics of a reducerless drive consists in the need 
to construct an industrial robot control system with regard to the 
dynamics of the manipulator mechanism, which in turn requires 
construction of high-performance computers and real-time operating 
systems. Difficulties arise in design of a drive for assembly robots, 
since in this case the industrial robot should reproduce the given laws 
of variation of forces, along with reproduction of the given laws of 
motion. 


Robotic vision systems and force-moment sensitization are mainly used in 
industrial robot sensitization systems. 


The robotic vision systems (STZ), used under production conditions, 
ordinarily operate with images of 256 x 256 or 512 x 512 elements, the 
brightness of each of which is encoded by 6 or 8 bits. An essential 
parameter of robotic vision systems is their speed. A large volume of 
data on the image (up to 256 kbytes), rigid time restrictions on the 
permissible time of processing one image impose their own imprint on the 
architecture of the hardware and on the structure of the software of 
robotic vision systems. The apparatus of a robotic vision system 
usually consists of several modules, operating synchronously or in 
parallel, performing the main volume of image processing with equivalent 
speed of 10 million image elements per second. Examples of these 
systems may be the SERIA 150/151 of Imaging Technology, Inc. (United 
States) and the DT 2861, DT 2858, and DT 7020 modules of Data 
Translation, Inc. (United States). 


The indicated modules perform all the preliminary data processing, 
related to viewing large files of points, using point image algorithms, 
realized at the hardware level, filtration, calculation of brightness 
gradients and histograms, contour description, computation of 
convolution and so on. The final image description operation in some 
database and decision-making base is performed on a personal computer or 
on a specialized controller. 


Among the robotic vision systems manufactured in the USSR, one should 
mention the Videosens, MB-196 and Vedoskan systems, which, although 
somewhat inferior to the above mentioned microprocessor robotic vision 
systems in their parameters, process an image within 1-2 seconds at 


considerably lower cost. 


The force-moment sensitization systems of industrial robots, 
manufactured in the USSR and abroad are completely functional high-class 
instruments, which measure six projections of the force vector and force 
moment, conversion of analog data to digital form, processing and 
transmission of it to the robot controller or to other equipment through 
a serial interface channel. 








Examples of force-moment systems may be: the Dinasens-200 NTs 
Robototekhnika (USSR) and the FS6-120A of the Astek, Inc. Company 
(United States). 


It should be noted that the use of real-time sensory systems (for 
example, during assembly, requires development of special contro] 
algorithms and an increase of the requirements on the characteristics of 
the controllers. 


Among other problems that require scientific studies, one should mention 
those of increasing the speeds of industrial robots to 10-15 m/s, 
increasing the capacity to natural mass ratio of industrial robots, and 
reducing energy consumption and materials consumption. Systematic study 
of the technological and economic feasib: lity of using robotics in 
modern industrial production is necessary to improve the effectiveness 
of introducing industrial robots. 


The authors are grateful to corresponding member of the USSR Academy of 
Sciences Ye. P. Popov, and also to colleagues of the Scientific Training 
Center Robototekhnika G. V. Pismennyy and \. A. Polskiy for assistance 
in compilation of this sur ey. 
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[Text] Analysis of the structural-configuration 
layouts of flexible manufacturing systems, based on 
the use of morphological Zvicky analysis, is 
considered. Classification features of structural- 
configuration layouts of flexible manufacturing 
systems are determined. 


The subjective, empirical approach now predominates in design of 
structural-configuration layouts of flexible manufacturing systems 
(GPS), which reduces their effectiveness due to constriction of the area 
of searching for possible solutions. Therefore, the }roblem of studying 
processes of objective, formal structurization of manufacturing systems 
based on morphological methods is timely. 

Analysis of the structural-configuration layouts of flexible 
manufacturing systems, based on the use of morphological Zvicky analysis 
[2] and further development of it in [3, 5]. Two qualitatively 
different steps--morphological analysis and morphological synthesis--are 
distinguished in the morphological! method. The step of morphological 
analysis consists in many-sided consideration of the technical system 
and desvription of it in some space of features. The main problem of 
this step is careful study of the design principles of the system, of 
the structural components and different itorms of their interaction in 
the system. The purpose of morphological analysis is development of 
morphological classifiers, which encompasses all the possible structural] 
solutions of the technical system. The step of morphological synthesis 
consists in analysis and selection of a set of possible solutions of 
those which correspond to the advanced requirements. The purpose of 
morphological synthesis is working out optimization algorithms that 
permit ore to orient oneself in the space of possible solutions. 











The most acceptable is the method of the morphological Zwicky box among 
the known morphological methods for problems of formulating the 
structural-configuration layouts of flexible manufacturing systems. 
According to this method, the technical system is studied by 
distinguishing a number of typical features, to which formal variables 
x; correspond and on which the structural solution is dependent. 
Gradations are found for each feature, i.e., mutually exclusive values 
of the same variable. The qualitative state of the structural component 
is reflected by an ordinal number of the i-th variable, the number of 
which varies from 1 to k,. Each of the possible j-th realizations, 
corresponding to the i-th value of the variable, is selected for 
formation of the structural solution. 


Graphically, the process of formation of structural solutions can be 
represented in the following manner. Data on the features of variables 
and of their gradations ave represented in the form of a morphological 
table: 
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Structural solutions are formulated by interrogating the gradations of 
all features and of including them alternately in discrete sets that 
characterize one or another variants of the structural designs of the 
system. For example, 


It is obvious that a complete structural solution will be formulated 
only if each feature is represented by one of its gradations. The 
dimensionality of a specific set of possible structural solutions is 
generally determined by 








where n is the number of features and kj is the number of gradations in 
the i-th feature. 


Construction of the morphological classifier is a subjective procedure 
and is entirely dependent on the qualifications of the compiler. This 
process can be based on analysis of the structural-configuration layouts 
of existing flexible manufacturing systems and those operated in 
industry. Conducting this analysis means objective determination of the 
main structural design principles of the flexible manufacturing system 
by the expert method and determination of their quantitative analysis in 
the form of the applicability factor, which characterizes the fraction 
of the flexible manufacturing system with given structural feature in 
the total set of those studied. This approach guarantees determination 
of all the structural features of the flexible manufacturing system and 
provides a panorama of their use in practice. 


The production design characteristics of manufacturing objects affect to 
a considerable degree the selection of one or another principle 
structural-configuration layout of a flexible manufacturing system. 
Specifically, the design, overall dimensions and shape of objects affect 
the selection of the automated transport-warehousing system of the 
flexible manufacturing system. Taking this characteristic into account, 
the entire combination of studied flexible manufacturing systems must be 
divided into two groups upon morphological analysis: flexible 
manufacturing systems, designed to manufacture objects of prismatic 
shape (housing parts)--GPS(Pr)--and flexible manufacturing systems, 
designed to manufacture parts of the body of revolution type--GPS(Tv). 
The applicability of the structural solutions ‘Ip and fing? respectively, 


is determined within the limits of each of the groups. 


The following classification features are determined as a result of the 
structural-configuration solutions of more than 200 flexible 
manufacturing systems, data on which are presented in [1, 7, 8]: 

x;--the type of flow scheme of blanks, x9--the principle of organization 
of accumulation of production objects, x3--the principle of arrangement 
of the main production equipment with respect to the flow of production 
objects, X4--the principle of organization of the automatic checking 
system, x5--the principle of organization of the automated tool support 
system, and xg--the principle of organization of the automated waste 


removal system. 


The given classification features fully characterize the technological 
system of a flexible manufacturing system, which includes, according to 
GOST [State Standard] 26228-85, an automated transport-warehous ing 
system, automatic checking system, tool support system and waste removal 
system. The problem subsequently reduces to study of the set of 
structural-configuration layouts of the flexible manufacturing system 
according to the adopted classificat.on features, determination of the 
gradations of these features, and also according to the quantitative 
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analysis of the applicability of structural solutions by coefficient Ip 
and frp: 


The results of the analysis are presented in Tables 1-6. It must be 
noted that analysis of the principles of organization of automated tool 
support system (Table 5) and of a waste removal system (Table 6) showed 
that the class of manufacturing objects does not affect the organization 
of these systems; therefore, the analysis was performed for a general 
combination of flexible manufacturing systems without separation into 
GPS(Pr) and GPS(Tv). 


The analysis permitted us to formulate a morphological table of the 
principal structural-configuration layouts of a flexible manufacturing 
system, which includes the entire set of the possible structural- 
configuration layouts of flexible manufacturing systems. Performing 
alternate interrogation of the gradations of all the structural 
features, one can find the set of variants of the structural design of 


the system 


V= {wi} 


(where i = 1, N), each of which is a sample of the gradations of the 
features of variables, for example, 


Wr = {x,3, X2", x3°, x4, X5>, x67}. 


This structural solution is characterized by: the use of a rectilinear 
broken type of blank flow, by centralized separate arrangement of blanks 
and of machined parts, by location of the main production equipment 
under the main transport path (overhead transport is used), by 
implementation of automatic checking, by organization of developmental 
support based on the main transport system of the flexible manufacturing 
system with the flow of tools from a central tool wareliouse (TsIS) 
directly to the machine tool without intermediate storage on a separate 
section (IU), and removal of wastes on the basis of the main automated 
transport-warehouse system of the flexible manufacturing system. 
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Table 1. Types of Blank Flow Layouts 
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KEY : 


1. Type of layout 9 Circular branched 
2. Representation 10. CirecuJar matrix 

3. Linear 11. Multirow 

4. Rectilinear 12. Matrix rectilinear 
5. Reversible 13. Matrix reversible 
6. Rectilinear broken 14. Network 

7. Closed 15. Radial 

8. Circular 


The problem of morphological analysis terminates in design of a 
morphological classifier. The problem of morphological synthesis can 
generally be formally described as [5]. 


The specific function f(¢;) is determined on set W, i.e., an algorithm 
for calculating this function f(#j) for any #; € W is constructed. 
Generally /(:) = {fa(@i), k=1, m} is a set of criteria, part of which is 


minimized, and part of which is maximized. The problem of morphological 
synthesis consists in removal of 


fo{wi} > opt/aEV; 
f;(@i) 0, fp (wi) <0, 


where fo is the optimal value of the criterion of quality, fj(wj) and 


fp(w,) are restrictions, and j = 1, k, p=k +41, Mm. 


The following methods can be used to solve the problem of morphological 
synthesis with the vector criterion of quality: sequential analysis and 
elimination of variants of design solutions [4], competing points [6], 
and filtration for tree-like design [5]. 
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Table 2. Principles of Accumulation of Blanks and Parts 
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1. Principle of accumulation 8. Accumulation on transport 
and location system 
2. Representation 9. Note 
3. Centralized 10. Automated work position 
4. Common 11. Automated storage 
5. Separate 12. Storage device common for 
6. Decentralized blanks and parts 
7. Combination 13. Storage device separate for 
blanks and parts 
Table 3. Principles of Arrangement of Production Equipment 
With Respect to Blank Flow 
(2) 
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1. Principle of arrangement 
2. Representation 
3. Work positions arranged in direction from main transport path 
4. With common branching for input and output of blanks and parts 
5. With separate branching for input of blanks and output of parts 
6. Work positions are located 
7. Under main transport path 
8. On main transport path 
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Table 4. Principles of Organization of Automatic Checking 
System of Flexible Manufacturing System 
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Table 5. Principle of Organization of Automated 
Tool Support System of Flexible Manufacturing System 
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1. 
Manufacturing Systems of Japan], translated from Japanese by A. L. 
Semenov, edited by L. Yu. Lishchinskiy, Moscow, Izdatelstvo 


"Mashinostroyeniye”, 1987. 


ID 1 & WwW NH 





Principle of organization 

Notation of variable 

Value of applicability factors 

Special automated tool support systems 

Central tool storage-machine tool 

Central tool storage-tool section-machine tool 
Organization of tool support based on automated transport 
warehouse system of flexible manufacturing system 


8. Delivery of tool manually on carts 


Table 6. Principle of Organization of Automated 
Waste Removal System of Flexible Manufacturing System 








~ 
Osean a2, - | Suavebsae AO>)- 
Mpuwunun oprakiusaunn (1) neperenuon | PuuueHTOB Mpii- 
: | MCHAMe MOCTI 
(4) | | 
Cneuwarabibie aBTOMATH3ZIPOBaHHSie = cuCcTe’L | x 0,41 
VlaceHHa OTXO10B 
' 
Yaastenne otxozos wepes ATCC TMC (5) | Xe? 0,19 
Yiaaenne eukocteii c oTxolzaMi ¢c nomoupo | x53 0,40 
KDAN-OatOK H PVYNDIX Teae AER (6) 


1. Principle of organization 

2. Notation of variable 

3. Value of applicability factors 

4. Special automated waste removal systems 

5. Removal of wastes through automated transport warehousing 
system of flexible manufacturing system 

6. Removal of tanks containing wastes using boom cranes and hand 
carts 
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[Text] Methods are proposed for synthesis of 
correction algorithms for control of assembly 
processes and parametric correction of simulation 
models of flexible manufacturing systems, based on 
hierarchical Petri nets. Problems related to 
development of effective methods of control of 
assembly processes and to analysis of them by 
simulation are considered. 


The assembly process as an object of automation is characterized by 
cyclicity, hierarchy of representation of production processes, 
asynchronism and parallelism in operation of assembly equipment. This 
multiplan layout and complexity of assembly manufacturing determines the 
need to use methods of simulation in problems of analysis, design and 
control. The most effective means of solving problems of simulation of 
objects of a given class is the apparatus of Petri nets (SP). Practical 
application of Petri nets requires specific modification of their 
classical apparatus. In the given case, this modification is directed 
toward solution of the following problems: adequate description of the 
simulated object, the possibility of designing automated procedures of 
synthesis of control models of assembly processes, and implementation of 
automated control of simulation experiments. 


Problem 1. It is suggested that a modification of the Petri net--a 
hierarchical painted net (IR-net), which has the properties of animation 
and safety--be used as a model of the discrete assembly process. The 
positions of the net in this model are compared to the operations of the 
process, transfers are compared to events of a change of operations, and 
the colors of marks are related to elements of material and information 
flows. The characteristic feature of the proposed modification is 
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construction of a known correct (animated and safe) net with as large a 
number of elements as desired from some simple nets, which show the 
properties of the object of simulation, the correctness of which has 
been established. Let us call the IR-net a structure consisting of a 
finite set of correctly formulated net structures (blocks) N = {Nj}, 


where 


N;=(Pi, T:, Fi. Ai, 
Qi, hi, vi, Uo’) ’ 
T,=T7,*UTiuUT is, 


T= {ty| WoeP:: Fi(p, tu) =O}, Tis= {ts| WoePi: Hilts, -) =O}, 


on which the operation of substitution of the net block is determined. 
This set is partially ordered and graphically represented by a tree, to 
the root of which corresponds an elementary net or correctly formulated 
block. The elementary net is a strongly connected automatic net of two 
positions and two transitions with initial distribution of all colors of 
the marks in one of the positions. The substitution operation is an 
operation of superposition of the net structure of the block ona 
fragment of the net with a doubler position, substitution of its input 
and output transitions-sources ty and discharges t, of the block and 
removal of the doubler position from the received net. The block is 
considered correctly formulated if substitution of it instead of the 
position of the elementary net generates an animated and safe Petri net. 
it is shown that any Petri net, belonging to a class of correct IR-nets, 


is animated and safe. 
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The form of representation of correct IR-nets is determined. It is 
suggested that six typical blocks that give the main ratios of the 
relationship of operations of the manufacturing process be used, an 
automatic block (Figure 1, a); an alternative block (Figure 1, b); a 
cyclical block (Figure 1, c); a parallel block with the absence of 
interactions (Figure 1, d); a parallel block with synchronization by 
event (Figure 1, e); and a parallel block with competition (Figure 

1, f). The type of net structure of the root of the vertex of the tree 
of the IR-net predetermines the class of the simulated processes. The 
elementary net of the root vertex corresponds to cyclical processes, 


while a net structure, represented by an automatic, alternative or 
cyclic block with introduced inhibitor arcs that guarantee its safety 
corresponds to a conveyer net. 


Problem 2. Management of the manufacturing system in terms of a Petri 
net reduces to the need to manage transitions of the net as a function 
of the markings of its positions. The problem of synthesizing the 
control model consists in assigning the representation (PR), which 
determines the order of response of competing transitions, on a set of 
transitions T of a model of the process N. The control] algorithm is 
given in the form of a control net Ny = (N, X, ¢, Y, f, PR), where X is 
the set of states of the control object, Y is the set of control 


actions, g:T 7 ox is a function of clear agreement of the set of 
transitions and subset of states, f:4 ~ Y is a function of the clear 
conformity of marking of the net and the set of controls, and 

PR:(P x Q) x T- {0, 1, ...} is the priority function of response of 
transitions of the net. . 


Problem 3. Automated simulation (AIM) in control and design problems of 
assembly plants is related to implementation of direction runs of the 
simulation model (IM) to find a combination in the given range of 
variation of input parameters that provides the best value of some index 
of quality (performance, cost and so on). The conditional structure of 
the AIM is represented by the simulation model itself and by the 
experiment control device--the search model (PM) (Figure 2). 
Hierarchical representation of the simulation mode] based on the 
proposed net structures guarantees direct interaction with algorithms of 
the search model and the possibility of parametric correction of the 
model. 
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Figure 2 








The search model algorithm realizes some optimization method. Its 
specifics consists in calculating the index of quality on the basis of 
the results of the run of the simulation model. The relationship of the 
parameters represented in the simulation model, the length of the run of 
the model and other characteristics require correct and effective 
organization of management of the series of experiments. The 
correctness of interaction of the search and simulation models is 
maintained by specially developed control procedures. Based on 
decomposition and analysis of the structure of the discrete optimization 
algorithms realized in the search model, methods of improving the 
efficiency of automated decision-making during control of experiments 
were worked out. 


The proposed modifications of net methods and approaches to use of them 
permit an increase of the effectiveness of solving complex object 
control problems, and also design and automated simulation of assembly 
plants. 
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[Article by S. V. Goryachev and M. Ya. Ostrovskiy, Leningrad 
Polytechnical Institute imeni M. I. Kalinin] 


[Text] Implementation of contour control in multilink 
articulated manipulators based on solution of the 
inverse kinematic problem is considered. Algorithms 
are proposed for solving kinematic controls based on 
combination use of a modified "number by number” 
method. The characteristics of hardware and 
microprogram support of contour control based on a 
functionally oriented processor in the SChPU 4S-02 are 
described. 


When developing NP systems for contour control of industrial robots 
(PR), main attention is devoted to algorithms for solving trajectory 
problems, which determine to a significant degree the accuracy of 
reproduction of the trajectory and the speed of the industrial robot [1, 
2]. A distinguishing feature of NP systems of multilink manipulators is 
the need to solve two main problems during control of motion: the 
problem of i:terpolation that calculates the position of the industrial 
robot grab in Cartesian coordinates and the inverse kinematic problem 
(OKZ), which calculates the angular coordinates of the industrial robot 
according to the given Cartesian coordinates of the grab. Whereas the 
interpolation algorithms are now well known and are widely used in 
machine tool NP systems [1, 2], algorithms for solving the inverse 
kinematic problem in real time have been very weakly developed. 


Numerous gradient and other iterative algorithms for solving the OKZ [3] 
contain a large number of operations of multiplication, division and 
computing the trigonometric functions and, therefore, are used only for 
simulation of the motions of the industrial robot. In this regard, 
preference is given to analytical solution of the OKZ [4] with 
subsequent tabular implementation of the main trigonometric functions in 
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NP systems of 5-6-degree manipulators. A disadvantage of this approach 
is the large volume of tables and at the same time the long cycle time 
of solving the OKZ (up to 75-125 ms). 


Thus, working out analytical or tabular-analytical methods of solving 
the kinematic equations of multilink manipulators, which reduce the 
volume of tables and the time of solving the OKZ, and also those adapted 
for effective implementation on functionally oriented processors (FOP), 
performed within the NP system, is promising. 


Mathematical postulation of the problem is dependent on the design of 
the industrial robot. Let us consider as an example a system of 
equations that describe the kinematics of one of the relatively simple 
robots of the TUR-10 type (Figure 1): 


V= [L2 cos(Q2)—L3 cos (Q2 + Q3) + L4 cos (Q2+Q3+Q4)Jcos(Ql); | 

Y= [L2 cos (Q2)—L3 cos (Q2 + Q3) + L4 cos (Q2-- Qo+ Q4) Jsin(Q]); 
7=L1+L2sin(Q2)—L3 sin(Q2+Q3) ~L4sin(Q2+Q3+Q4); (1) 
l= Q2-03+Q4; 
O=QI1: 

T=(Q5, 





where X, Y, and Z are the Cartesian coordinates of the grab, A, O, and T 


are the orientation angles (Euler angles), Lj (j = 1, 4) are the lengths 
of the links, and Qi (i = 1, 5) are the angles between the links. 


Figure 1. Kinematic Layout of TUR-10 Robot 





The expressions look so simple for the orientation angles due to the 
simplicity of the design of the robot. 


Analysis of relations (1) shows that the fraction of trigonometric 
operations and multiplication operations is high both when solving the 
direct kinematic problem (PKZ) (the Cartesian coordinates are determined 
by the angles of rotation of the links) and when solving the inverse 
kinematic problem. Thus, the number of "long" operations when solving 
the OKZ, depending on the method of solution and on the design of the 
industrial robot, fluctuates in the range of 12-16 transcendental 
functions, and 30-40 multiplication and division operations and 
extracting the square root for different types of six-link manipulators 
[3, 4]. 


Ordinarily, trigonometric transformations are determined as standard 
transformations, and different methods are used to implement them [5]. 
At the same time, as follows from analysis of relations (1), more 
complex operations of transformation and rotation of the coordinate 
system can be distinguished as typical (POLDEK--transformation from a 
polar to a Cartesian coordinate system, DEKPOL--transformation from a 
Cartesian to a polar coordinate system, and ROTATE--rotation of a 
Cartesian coordinate system). The algorithm for solving the inverse 
kinematic problem can be represented with regard to the introduced 
operations in the form presented in Figure 2. 
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Figure 2. Algorithm for Solving Inverse 
Kinematic Problem 
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The use of POLDEK and DEKPOL commands reduces the number of "long" 
operations, which results in a reduction of the time of fulfilling the 
algorithm. The use of the "number by number" method [2, 5], 
specifically, Volder and Medjit methods, is promising for fulfillment of 
these operations. Although the given methods have a disadvantage in 
speed to some other methods of calculation of trigonometric functions, a 
significant advantage is achieved in the given case due to multiple use 
of all the functional capabilities of the operations. For example, the 
POLDEK operation is "equivalent" to simultaneous fulfillment: sin, cos 
and two multiplications. 


The NP systems of industrial robots are now constructed on the basis of 
universal 16-bit microprocessors, the architecture of which is 
insufficiently effective for solving a class of trajectory problems [1]. 
This is caused by the small word length and rigid fixed list of 
commands. An effective method of solving the performance of 
general-purpose microcomputers is connection of functionally oriented 
processors. The use of functionally oriented processors, oriented 
toward solution of only trigonometric problems, is undesirable in 
universal terminal control systems (TSU) of modules of flexible 
manufacturing systems, which include not only robots, but machine tools 
and other auxiliary equipment. 


The 4S-02 terminal control system has been developed at the Leningrad 
Polytechnical Institute for control of the modules of a flexible 
manufacturing system that includes the SChPU Elektronika NMS-12402 
control module (based on the K1801VM1 microprocessor) and a functionally 
oriented processor-active memory module (MAP) [6]. The distinguishing 
features of active memory modules are the increased word length of the 
operations block (48), the memory capacity--4K 48-bit words, hardware 
support of realization of complex logic transformations, and dynamic 
microprogramming that introduces specialized commands. 


The indicated commands--POLDEK, DEKPOL and ROTATE--are realized at the 
microprogram level for effective solution of trajectory problems in the 
active memory module. The iteration procedures that realize these 
commands are reflected in the table. The given relations are variants 
of known Volder and Medjit algorithms [5], modified for more complete 
consideration of the architectural features of the active memory module: 
48-bit words, 2-bit shifts and other features of the operations block. 
The most significant characteristics of the algorithms are enumerated 
below. A specially developed microprogramming automation system SYMON 
was used for microprogram realization of typical commands [7]. 
Inclusion of the given operations into the command system of the active 
memory module enhances the level of its internal language, while 
microprogram realization reduces the time of fulfillment of 
trigonometric operations by a factor of 2-2.5, compared to program 
realization. 
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Note. K is a Volder constant (K % 1.65); A, B--addresses 
of operands participating in commands, third independent 
variable that participates in ROTATE command, is transmitted 
through one of the RONs [not further identified] of the 


active memory module. 


The characteristic features realizing the above operations in the active 
memory module reduce to the following: 


1. The algorithm mainly corresponds to a Medjit algorithm, which, 
compared to a Volder algorithm, guarantees greater accuracy and speed of 
computations, and also has hardware support in the active memory module 
in the form of shift microoperations by two bits simultaneously. 


2. Unlike the Medjit algorithm, one cycle was organzied for the POLDEK 
and ROTATE operations: the rotations are performed, beginning with the 
largest angles (as for the Volder algorithm). Upon completion of the 
cycle, the result is shifted by N bits to the right. There are no 
losses of accuracy, since additional bits can be stored due to the long 
word length of the active memory module in calculation with accuracy up 


to 24 bits. 


3. The angles of rotation can be given in degrees, radians or other 
units (sensor codes) by switching by program to one or another table of 
constants. This permits one in many cases to do away with additional 
scaling of operands when shaping drive control signals and "saves" 
five-six multiplication operations. There are no restrictions on the 
value of the angles of rotation. The constants correspond to the Volder 
algorithm. A longer word length permits one tc select the number of 
additional bits, necessary for the requiied accuracy. 
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4. Program adjustment for the accuracy of the calculations is possible 
and a proportionai increase of the time of fulfillment due to accuracy 
is provided, 


5. There is a K-bit shift to the value K = P, where P is ordinarily 
selected equal to N/2, but it can be changed by program as a function of 
the required accuracy. 


We note that a long word length of the active memory module permits one 
to store the values of coordinates, squares and fourth powers of 
coordinates in one cell, necessary for realization of operations in 
blocks 8 and 10 of the algorithm for the inverse kinematic problem 
without a loss of accuracy (see Figure 2). A total of three-four memory 
cells would be required to store the intermediate values when realizing 
the algorithm on a general-purpose microcomputer, which would 
considerably reduce the speed of performing the operations. 


Problems, similar to robot control problems, are also encountered for 
multicoordinate machine tools having rotary coordinates. Whereas 
accuracy for performing 16-bit operations is ordinarily sufficient for 
robots, 20-24 bits are required for a machine tool. There is a 
nonproportional increase of the completion time with an increase of 
accuracy when the given algorithms are realized on a microcomputer. 
Thus, the completion time is Ty (16) = 2.07 ms with accuracy of 16 bits 


and T (24) = 4.1 ms with accuracy of 24 bits for the Elektronika-60 


computer with realization according to Medjit [2, 5]. The corresponding 
times are equal to Ty{ 18) = 0.5 ms and Ty! 2?) = 0.8 ms for an active 


memory module. The total time of solving trajectory problems for a 
manipulator of the type given in Figure 1 comprises: 2.6 ms for the 
direct kinematic problem and 4 ms for the inverse kinematic problem 
(with accuracy of 16 bits). The characteristics for the Elektronika-NMS 
12402 microcomputer are similar: 10 ms for the direct kinematic problem 
and 16 ms for the inverse kinematic problem. 


As indicated earlier, speed is increased due to the use of an algorithm 
(see Figure 2) containing a fewer number of "long" operations than 
ordinarily used algorithms, as a result of using complex POLDEK and 
DEKPOL commands, as a result of using modifications of the Volder and 
Med jit algorithms that permit a reduction of the time of fulfilling the 
algorithm due to the long word length of the active memory module and 
also due to transition of the algorithms to the microprogram level when 
solving the direct and inverse kinematic problems. 


Thus, realization of contour control is feasible on the basis of complex 
operations of transformation of coordinates, realized at the 
microprogram level in a functionally oriented processor, and which 
considerably increase the performance of a general-purpose 
microcomputer. 
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[Text] Algorithms for adaptive control of a robot, 
based on correction of programmed motions at fixed 
parameters of the control law, are considered. The 
calculating relations and experimental results of 
simulation of the developed algorithms are presented. 


The efficiency and reliability of traditional robot program control 
systems are reduced significantly under indeterminant production 
conditions of operating them. This is manifested in a decrease of 
accuracy, occurrence of vibrations, soft failures and hard failures. 
One of the effective methods of increasing the reliability and quality 
of functioning of a robot is the use of adaptation devices in their 
control system, which provide automatic adaptation to various types of 
disturbances and noise. Known methods of adaptation are based on the 
sue of algorithms for identification of unknown factors or on 
self-adjustment of the parameters of the control laws. However, they 
are complicated, which makes it difficult to implement them in a robot 
control system. 


New adaptive control algorithms, based on correction of the programmed 
motions (PD) of the robot as a function of the nature and level of 
perturbations and noise occurring under real operating conditions of the 
robot, are proposed in this article. 


Postulation of problem of program-adaptive control of robot. The 
dynamics of a wide range of robots is described by a system of 
differential equations of type 


A(g, $)qg°+6(g, g,..., go", 2) =uta, (1) 
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where q = q(t) is an m-dimensional vector function of the generalized 
coordinates, q‘'!’ is its j-th derivative by time t, j = 2...r, € = &(t) 
is the p-dimensional vector function of the robot parameters, u = u(t) 
is an m-dimensional vector function of control actions, A(q, é), 
b(q...q'*®~!’, &€) are given m « m and m functions, respectively, 7 = (t) 
is an m-dimensional vector function of constant external perturbations, 
about which it is known only that |x (t) || ¢ cx, where c7 is some positive 
value. The order of r vector differential equations (1) is dependent on 
the type of motors used in the robot. In the case of torque motors, 


r = 2; when using DC motors, r = 3. 


Let it be required to switch the robot during time T = tr - ty from a 


given initial state to the desired final state, determined by the 
following boundary conditions 


9 (to) =go.-- 9°" (to) =o"; a (tr) =gr... 9°" (tr) =ar” 16 
with given accuracy ¢. In this case, the purpose of control is given by 
WE (tr) i<e, (3) 


here F(t) ={e" (t)};-0 s e(t) =@(t)—@>(2). In practice, only part of the 


combination of boundary conditions rather than all of them, usually 
boundary and specific conditions, are frequently given 


or 


(6) 








Solution of this problem is naturally divided into two steps. The 
programmed motion ¢)(!). '=|%, ‘r], which satisfies boundary conditions 


of type (2), (4), and (6), is synthesized in analytical form. In the 
second step, the control law that guarantees fulfillment of specific 
conditions of type (3), (5), and (7) is synthesized. The control] laws 
that solve the formulated problems will be called terminal laws. They 
are primarily oriented toward use in robot position control systems. 


The specific condition in contour control systems generally has the form 
E(i)i<e; t=[bo. tr] (8) 


If truncated boundary conditions (4) and (6) are given, the specific 
condition has the form 


e(t)|\<e; t=[%o, tr] (9) 


or 
(10) 


This means that the contour control laws guarantee tracking of a given 
programmed motion q,(t) and possibly of its derivatives in the sense of 
(8), (9), and (10) with given accuracy over the entire range of motion 
[tos te] ° 

Solution of terminal (position) and contour control problems is 
complicated by the fact that in practice there may be initial, 
parametric or constantly acting perturbations. They have an unfavorable 
influence on the quality of control, and result in a decrease of 
accuracy, in autooscillations or even ina loss of stability. 

Adaptation devices are necessary to compensate for the indicated 
perturhations. Effective methods of adaptation, based on identification 
of unknown perturbing factors or on self-adjustment of the parameters of 
the control laws, are suggested in [1-3]. 


A new method of adaptation in positioning and contour control systems, 
the characteristic feature of which includes the fact that the 
programmed motion is corrected instead of the parameters of the contro] 
law, is studied in the article. This permits one to use ordinary 
positioning and contour control systems with standardized regulators of 
actuating drives, supplementing them only by programmed motion 
correction programs, which implement the program-adaptive contro] 





algorithms suggested below. For definiteness, robots with DC motors 
whose dynamics is described by differential equation (1) at r = 3 and 
specific conditions of type (5), (7) and (9), (10) are considered. 


Program-adaptive position control algorithms. Let us take as an example 
the problem of position (terminal) control with a specific condition of 
type (5) or (7). The parametric optimization method of programmed 
motions, proposed in [2, 3], can be used for analytical synthesis of 
programmed motions with regard to given boundary conditions (4) or (6). 
However, it requires solution of the variational problem, which 
complicates analytical synthesis of programmed motion. Therefore, let 
us consider simpler algorithms for analytical synthesis of programmed 
motion. The desired programmed motion for boundary conditions (4) is 
described by a linear function of type 


Qp(t) = Gor (Gr—Go) (t—to) /T (11) 


at t € [ty tol and by a third-power polynomial for boundary conditions 
(6) 


Gn (t) =9o+xi (f—to) + Ho (f—ty)?/2 + x3 (f—to) 9/6. (12) 


. { 2 Cis . 
Here t=[lo, tr]. 4,=Yo, Z2= TT (gr —- g,) ale (Jr ~qo), es . ee 
(dr Jy) oe (Gr — Qp). 


Let us consider the stabilizing control law 
Aig, =) [4, +1. (q—gp) Tv D2(Gg—Gp} +T;(g—@p)]- 0(4, q, q, 3) (13) 


in which [;, [2, and [3 are m « m matrix amplification factors in the 
feedback channels, selected from the condition of providing the desired 
nature of the transition process (PP). It is sufficient to take 
matrices [,;, fo, and [3 as diagonal to compensate for cross-connect ions 
in a closed system. By substituting (13) into (1) at r = 3, we find the 
equation of the transition process in a closed system 


E=PE+A~‘(g, 8)a, 
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o7 oO: 


where E = {e!) (t) }2;2, €=q—Gp, r=(0 


r 
13 49 


The following estimate in component form is valid: 








Wecaily jo (0) | 
eli <e ace 
le (t) || le (2,) | 


Here t > to, 7 is the module of the most essential part of eigennumbers 

of matrix I’, c is a positive constant, dependent only on 

positive number, p ¢ min 4; (A), where 4, (A) are the eigennumbers of 
1 


matrix A(q, €). 


If the initial perturbations are equal to zero, i.e., if 2 (fo) =e (to) =e (to 


selection of the amplification factors [,, 2, and [3 from the condition 


/ 


- 
ae | 


exp(— 7 (t 





yocu-'cnae! 


ensures fulfillment of specific condition (5) for programmed motion (11) 


— ty) + og tw ter, 


> 


and of specific condition (7) for programmed motion (12). 


Let us consider the case when the initial perturbations are distinct 
from zero and that their level ||E(to)|| < «0, where €9 is some positive 
integer. Let us assume that the constantly effective perturbations are 
™(t) = 0. Let us then select amplification factors [;, [2, and T3, at 
which the following inequality will be fulfilled, for the given times of 
motion T, accuracy ¢ and for the level of initial perturbations €» 


{271 . 


Control law (13) ensures fulfillment of specific condition (5) for 
programmed motion (11) and of specific condition (7) for programmed 


motion (12). 


Let *(t) #0. Then for given T, €, and €9, selection of the 


amplification factors from the condition (found on the assumption that 


exp(7T) > 1 + 97) 


y= (Ceo + Cp 'caT—e+y} (e—cro—cu— cal)? 
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[, andy isa 


guarantees fulfillment of (5) for programmed motion (11) and of (7) for 
programmed motion (12). It may happen in practice that the real level 
of initial perturbations (for example, due to the inaccurate initial 
setting of the robot) will be greater than given €o. Specific 
conditions (5) and (7) are then violated and adaptation of the control 
system is necessary. In this case, one could use the self-adjusting 
method of the control law by correction of parameters [,, [9, and T3 or 
of vector . But this method of adaptation with a large level of 
initial and external constantly acting perturbations may result in 
violation of the restrictions on control. Because of this, the control 
law may be unrealizable. 


A simpler and more effective adaptation algorithm in these cases may be 
one based on correction of the programmed motion at fixed structure and 
parameters of control law (13). The essence of this algorithm includes 
the fact that the programmed motion is adjusted by formulas (11) or 

(12), into which their true values determined by the position and speed 


sensor are substituted instead of qo and qo; at initial moment of time 
to. This single correction of the programmed motion is sufficient to 
guarantee fulfillment of specific condition (5) or (6) at the level of 
constantly effective perturbations 


cy-'woien<e. (17) 


Let us denote by t, some moment of violation of specific condition (5) 
or (7) with respect to programmed motion (11) or (12), respectively, 
constructed as a result of the first correction of the programmed 
motion. This violation may occur, for example, due to too high a level 
of constantly acting perturbations, which results in violation of 
inequality (17). There can be an adaptation to these unmonitored 
perturbations due to correction of the programmed motion. To do this, 
the programmed motion must be constructed according to formulas (11) or 


(12), having substituted the values q(t,) and q(tk), recorded by the 


position and speed sensor at moment of time tx, instead of qo and qo, 


and dimensionality ‘TS - te instead of T. One can show that specific 


conditions (5) and (7) will be fulfilled after the final number of 
corrections of programmed motion. 


Program-adaptive contour control algorithms. Let us now consider the 
problem of contour control of a robot with specific condition (9) or 
(10). The necessary condition for fulfillment of (9) and (10) is the 
low level of initial perturbations compared to the given machining 
accuracy of the programmed motion. It is necessary that lle( to )|| fC €0 < 
< € in the case of specific condition (9). Let us select the program 
motion in the form of (11) and let us use control law (13). Specific 
condition (9) will be fulfilled if the levels of constantly active and 


initial perturbations satisfy the requirement 
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Ce9+cy~'u-'ca<e. 


Otherwise, it may be violated at some moment of time t,. In this case, 
one must construct an auxiliary (corrected) programmed motion by formula 
(11), having substituted in it the values of q(t) and tr - te 


respectively, instead of qo and T. The programmed motion corrected in 
this manner is substituted into control law (13) and we check 
fulfillment of (9) with respect to the initial programmed motion (11). 
If it is violated, the auxiliary programmed motion, subsequently used in 
control law (13), is again corrected. One can show that the number of 
these corrections will be finite. The experimental results of 
simulation, considered subsequently, also indicate this. 


The program-adaptive contour control algorithm is constructed in similar 
fashion, but programmed motion of type (12) is used and corrected in 
control law (13). 


Results of simulation of program-adaptive robot contro] algorithms. The 
proposed program-adaptive control algorithms, based on correction of 
programmed motion, were simulated in the problem of control of an 
industrial robot of type (TUR-2.5) with actuating drives based on DC 
motors to perform manufacturing operations of laser machining of 
materials and the operation of grinding the edge of a blank during 
manufacture of footwear [4]. The adaptation was performed both with 
respect to errors of the initial setting of the manipulator and with 
respect to constant perturbations. Not only control law (13), but the 
programmed control] law of the following type were simulated 


Up=A (Gp, §)Gp+5(Gp, Gp, Gp, 2), (18) 


and the programmed control law with linear feedback was simulated by 
position and speed of the following type 


u=up+T2(q—gp) +T3(g—G,). (19) 


Control of the TUR-2.5 robot includes control of the manipulator 
directly according to degrees of mobility q; and q» and control of the 
working member (linear displacement and rotation of the grab). The 
first case is of the greatest applied interest. Let us present an 


explicit form of matrix function A(q, §) and vector function b(q, Gd, q 
€), used in control laws (13), (18) and (19), to make it more specific. 
With regard to the dynamics of DC motors, we find 
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A(q, 2) =LaK z= (Jp+-p-'n'Am(@, =m)), 


(4, 9. 9, £) = (LaKz'p "9 'Am (9, 


-R.K (Jp+p yn tdan(@, Em) )q> 


where 


[ ay, 2:2 COS(G Q>) 
Am(9,im)= | 


Lc V' SG — G2) 99 4} 


@.- Sin (g@,—@>-)a-°+5b; sing. +Kri@ 


bm (Q, 9, Em) -| 


—a;2 sin (9¢;—92)¢;2 +b: sin go + Kroge 
Qy; = 14,2 + (Met Mo) 1,7; Q)2=A2,= MolyTo=Molilo;  Gr9= Moro? + Mols*. 
by = (Mor2+ yl, + mol,) gb = (More+ Mole) g: 
En = {m. Mo, 11, fo, I, In, GO, Me K- : Kr}. 


Here m,, ly, mo, and la are the mass and length of the first and second 


links of the manipulator, respectively, r; and rs are the distances from 
the centers of gravity to the rotational axes of the first and second 
links, mo is the mass of the weight, g is the acceleration of gravity, 


and J, Ke P» Le Ro K) and K, are the constant diagonal 2 x 2 


matrices of the robot parameters. After the values of 7 that satisfy 
conditions (14), (15) or (16) as a function of the postulated problem 
have been selected, the amplification factors ' = diag(7;;‘')') can be 
calculated by the given eigennumbers (PE) < -7, r = 1-6 and by the 


formulas 


at i=l, 2. 


Let us consider the results of typical experiments in the problem of 
position control with specific condition (5). Programmed motion was 











synthesized in the form of (11), where q(to) = (1, 1; 1, 1), q(t) = 


= (1,0; 1,0), T = 1 s, and the required positioning accuracy is € = 
= 0.01 rad. The values of [; = -151, [, = 751, [3 = -125I (I is a 2 x 2 
unit matrix), corresponding to rp) = -5, r= 1...6, were taken as the 


amplification factors in (13). 








I= 2 
~ ~ 
“— Sy 10s 





Figure 2 


Graphs of the variation of generalized coordinates for three types of 
control law: stabilizing, programmed and programmed with linear 
feedback (trajectories 1, 2, 3, respective)--are presented in Figure 1. 
The level of the initial perturbations e(t 9) = (0.22; 0.22) considerably 
exceeded ¢ due to the errors of the initial setting of the manipulator. 
the real motion q(t) lies entirely in the e-neighborhood of the 
corrected programmed motion after one correction and, accordingly, (5) 
is fulfilled. Similar results were found in simulation of program- 
adaptive contour control of a robot with specific condition (9) and 
programmed motion (11). 


The graphs of variation of generalized coordinates for a stabilized 
‘control law without corrections of programmed motions and with 
‘correction of programmed motion (trajectories 1 and 2, respectively) in 
the presence of constant perturbations 7, the level cz of which exceeded 
the permissible level (17), are shown in Figure 2. The programmed 
motion (11) was corrected at moments of perturbation (9), and after this 
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(four correct ions), the specific condition (9) was fulfilled all the 
time. The use of control law (13) without corrections of programmed 
motion resulted in violation of (9) with « = 0,01 rad, which indicates 
the need to correct programmed motions at a high level of constant 
perturbations. 
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[Text] The problems of designing a two-way copying 
manipulator system with active reflection of force, 
self-adjusting upon variation of load parameters, are 
considered. The regulator is designed according to 
the quadratic criterion of quality. 


A human operator performs the decision-making and planning functions of 
the motion trajectories of the actuating member (IO) in copying 
manipulators (KM), and motions are distributed by separate degrees of 
freedom directly during operation. Two-way systems (SDD), located in 
each degree of freedom of the copying manipulator and which are systems 
of the actuating level of control, should provide precise tracking of 
the assigned trajectories of motion, and also reproduction of forces on 
the given member, developed in the degrees of freedom of the actuating 
member. The dynamic effects of the mutual influence between the degrees 
of freedom of the manipulator have a strong influence on the quality of 
operation of the two-way system during motion. 


A two-way system was designed in [1] with regard to variation of the 
load parameters. It was assumed that the variable moments of inertia 
and also the moments of gravitational forces have the main influence on 
the dynamics of the two-way system. However, besides inertial and 
gravitational forces, Coriolis and centrifugal forces, which can not be 
disregarded at high speeds (more than 0.5 m/s) of the motion of the grab 
of the copying manipulator [2], also affects the links of the 


manipulator. 


The problem of designing self-adjusting (SN) two-way systems is posed 
and solved in this paper with regard to the total dynamics of the 
actuating members of the copying manipulator. It is assumed that the 
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given member is light and its influence on the dynamics on any two-way 
system is determined only by the constant moment of inertia. 


The moment effect of any degree of freedom of the copying manipulator on 
a two-way system is generally determined by the expression 


( =H’ (g,...gw)an(t) +h (9)... ON; qi... QNi Qi... it, Giay... Qn), (1) 


where H®(qy ++ 6G) is the moment of inertia of the kinematic circuit of 
the actuating member with load with respect to the considered degrees of 
freedom, h(qy++ ys is a term determined by 


the effect of gravitational, Coriolis and centrifugal forces, and also 
by the components of forces of inertia, which were not included in the 
first term, Qy:+ + are generalized coordinates of the kinematic circuit 


of the actuating member, a(t) = qi,» i is the number of the considered 


degree of freedom, and N is the number of degrees of freedom of the 
manipulator. 


Let us consider a two-way system, the actuating elements of which are DC 
motors with independent excitation. The dynamics of these motors in the 
direction of the operator and load, respectively, is described by the 
following differential equations: 


w(t) = (Ry + Lipini (t) + Koriidon(t), 
Masi (4) = Kayla, (2) = Jit) Gon (Ef) +M;, (don) —Mon(t) /is; (2) 


tis (t) = (Ro+ Lop) ina(t) + Kusisan (t), 
Maso (tT) — A olae (ft) = Joioan (t) +My (an) + ()/To, (3) 


where R; and Ro are the effective resistance of the armature circuits of 


the motors, L,; and Ly are the inductance of the armature circuits, Kat 


and Kyo are the torque factors, Koy and K 9 are the coefficients of the 


counter, emf, J; and Joy are the moments of inertia of the rotors of the 
motors, of the rotating parts of the kinematic gears and of the 
corresponding links, i; and ig are the gear ratios of the reduction 


gears, Mz; (don), Mr2(an) are the dry friction moments, u;(t) and u(t) 
are the control voltages, ig, (t)s and igo (t) are the currents of the 


motor armatures, Mp1!) and Mapo') are the moments developed by the 


4] 





motors, Mon! t? and a,(t) are the coordinates of the operator and load 
shafts, Mon! t) is a moment developed by the operator and p is a 
differentiation symbol. 


According to the methods suggested in [1], let us assume that Qon’ Yon? 


on and » aw are independent input variables in the mode of induced 


motion of the operator shaft of the two-way system. Taking this into 


account and also taking into account relations (1)-(3), one can describe 
the dynamics of the two-way system in the mentioned mode with respect to 


phase coordinates (FK) \;=aa(‘), Yo=au(l), Xs =au(l), %4= Mon! t) by the 


following system of differential equations: 











x; No. _ | 
X, xX ’ 
K wok R,(J,-H)-—L,H Ky 
: - eat: & — Pe ° - le — 
49 La(/,-4) La(Jo — /1) Lo(/, At) 
— Rijb+e yy Rate Pf, >= 
; : 2 
i,(4g ~ Mf) “9 (7, ~ Ht) 
fe Ky Ky K 1 R . 

__ in % “1 "1 . _—— 
‘\~= L x, l :. “ ‘ L, 4 J ! ton 
a ail ij/, Lon i, (2, Ly , Pp) M.,, 





where H = H’/io?. 


Since the load shaft of the two-way system should accurately reproduce 
all motions of the operator shaft, the desired values for phase 
coordinates x;, x9, and x3 are given in the following manner: x ,* = 


=@on(t), X2*=Gon(t), %3*=aGon(¢). When giving the desired value for x4, one 


should proceed from the fact that the operator should sense the moment 
Qo, which is determined only by the object of manipulation. Therefore, 


let us assume that x4* =nQo=n[Joau(t) +Ao], where Qo = Q - Qy ay isa 
component of moment Q, determined by the parameters of the links of the 


actuating member, J, and hp are the components of elements H’ and h, 
respectively, determined by the parameters of the manipulation object, 
and n is a scaling factor. . 
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Since Q, = My 4, = Oy, then h = h(a, a.) Assuming that the two-way 


system operates sufficiently accurately, i.e., variables a, and a, 


hardly differ from Aon and Qon? respectively, function hia , a,,) can be 
expanded into a Taylor series [3] 





h (aw, au) =N (don Gon) (ay—Qon) +A(Gon, Gon) (yon) ~ G= 








; , (5) 
=A (toa, Gon) €2+A(don, Gon) e+ G, 
where 
h (@on, a,,) = S | » ¢ (Gon, Gon) = me 
0a, me ey a "h >. a 
G=h(an, aH)—A (don, Gon) €2—) (Gon, Gon) €). 
the term ho (ay a,,) can also be expanded into components similar to (5): 
ho(an, ay) = ho (don, Gon) €2 + ho (Gon, Gon)e; + Go, (6) 
where 
| ah. | _ Oh, 
hy (@on, Aon) = a a ; ; ’ hy (Zon, a...) —_ 02, -: ’ 
H rey H 0 mn oH on 


Go=ho(an, ax) —Ao(don, Gon) €2—* (Gon, Mon) &}. 


System (4), written with respect to errors of the phase coordinates, 
assumes the following form with regard to the type of desired values of 
the phase coordinates and expressions (5) and (6): 


(7) 
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It is obvious that system (7) is nonstationary, since parameters H, Jo, 


h, ho, A, Aa, H, Jo, h, ho, ), \, are essentially variables. 


Let us assume that the rates of variation of these parameters are much 
less than the rates of the transient processes in the system, i.e., let 
us assume that the parameters of the two-way system are quasi-steady, 
and the coefficients of the equations of system (7) then remain constant 
at small time intervals. In this case, system (7) will have the 
following form in vector form at each of the indicated intervals from 
the entire time range of operation of the two-way system: 


E(th=AEU) +B (2) ~1 (EF) + Wa, @, a), Etto) =X (to) —X* (bo), (8) 


here Fit)—\iry— You). £ +) =R* is a vector of the errors of the phase 


coordinates, X(t) € R*? is a vector of the phase coordinates of the 
system, X*#(t) € R* is the vector of the desired values, U(t) € R? is a 
vector of the control actions, B € R‘**® is a matrix of the amplification 
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factors during control actions, A € R**? is a matrix of the dynamic 
properties of the two-way system, f(E) € R* is a nonlinear vector 


function, and W(q, q; q) € R* is a vector of external effects. 


Let us assume that matrices A and B vary discretely upon transition from 
one time interval to another. 


One can use the method proposed in [4] to design a regulator of a 
two-way system on any of the indicated time intervals in view of the 
steady nature of the parameters of equation (8). According to this 
method, quasi-optimal control for stationary system (8), which minimizes 
the quadratic criterion of quality, is 


t 
J=0,5 f (E(t) DE (t) = 07 (t) WU (8) Jat, 
f 


ty and t; are the initial and final integration time, $ is a positive 
semidefinite matrix, and ¥ is a positive definite matrix 


U(t)=—D~ E(t)—D*}(E)—D*W. (9) 
where p~ ~W 'B°K, D!¥=D8=—wW-'Bt(A'—KBY~'B)K 
Matrix K is determined from a Riccati equation 
KA\+A°K—KBYW 'B’K+(P=0 
In scalar form, equation (9) can be rewritten in the form 
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Mr and Mp2 are the steady frictional moments of motion, and 1 = 1, 2. 


When realizing equation (10), the terms containing differentiation in 
232, gs2, and dg4 can be disregarded, since they have no influence on 
the dynamic properties of the two-way system after the beginning of 


motion of the system [4]. Moreover, terms proportional to @ on must be 


disregarded, since the value of a on can not be measured for use in 
control. 


Having designed a stationary regulator for each of the considered time 
intervals of operation of the two-way system, knowing the corresponding 
intervals of the values of the variable parameters, one can calculate 


the dependence of coefficient Kjm (1 = 1, 2, m= 1, 13) of the regulator 
of a two-way system on these variable parameters. The functions 
described in this manner are written to the computer memory and are then 
used to organize adjustment of coefficient K}q, of the regulator of the 
self-adjusting two-way system as a function of the current values of the 
indicated variable parameters of the manipulator. 


However, it is rather complicated to design and then to realize a 
self-adjusting two-way system with a large number of variable 
parameters, by which K}m should be adjusted. All the enumerated 
parameters are functions of the generalized coordinates of the actuating 


member q,, of their derivatives qj . q) (j is the number of the degree of 


freedom, j = 1, N, j # i) and of the mass of the object of manipulation 
mo. Therefore, the dependence of coefficients Kim of the synthesized 
regulator of a two-way system on the earlier indicated 12 variables can 


be transformed as a function of coordinates q), qj» qj and mo. If only 
three transferable degrees of freedom, which mainly determine variation 
of the load parameters of the two-way system [5], are taken into 

account, the values of Kj will be dependent on a maximum of 7 variable 


parameters rather than on 12, since j = 1, 3, j # i. Since the mass mo 
during operation of a copying manipulator ordinarily remains fixed, 

after calculation of it, for example, by the relations found in [6] on 
the initial step of motion of the manipulator, continuous adjustment of 


the amplification factors Kjm to functions of only six variables qj, qj» 


and qj is required. 
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Studies of the effectiveness of the proposed approach were conducted on 
the example of a two-way system of the first degree of freedom of a 
copying manipulator, the kinematic layout of the actuating member of 
which is presented in Figure 1. The considered actuating member has the 
following parameters: lengths of links 1; = ly = 0.5 m, mass of links 
m; = 10 kg and mg = 5 kg, moments of inertia of the links with respect 
to the axes of the joints J; = 0.85 kg-m?, Jo = 0.42 kg-m’, and mo = 

= 1 kg. The numerical values of the parameters of the fixed part of the 
two-way system are presented in the table. 








) Kw. | Kus, J; s b.. . | Ms 








| Nem/?. Ves kg-m* Ohm 4H "| Nem ° 
l 1,13-10-2 1,13-10-? 8,96-10-° 3,8  7,o-10-* 180 2-10-73 





to 


1,99- 10-2 1.59-10-? | 405-107" 0,0) 3-107" t6 ».10-? 


The mode of stimulated motion of the operator shaft of the first degree 
of freedom according to the law a,,=1(f)/(0,167p—1)* at different modes 


of motion of the second degree of freedom of the copying manipulator was 
considered during studies of a two-way system. Curves, corresponding to 
variation of the angle of rotation of the second degree of freedom by 


the law av2=1,5[1+sin(af+2/2)] , are presented in Figure 2, while 
curves corresponding to variation of the angle of rotation by the law 
an = 1,911+ sin(at—x/2)]. are presented in Figure 3. The number 1! denotes 


curves for the case when a self-adjusting two-way system is accomplished 
only by the variable inertial parameters similar to [1]. The 
centrifugal and Coriolis forces during shaping of the control signal 
(control law) were disregarded. The curves denoted by the number 2 
correspond to the case when the parameters of the regulator of the 
two-way system are adjusted as a function of variation of all the load 
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parameters (with regard to the moments of high-speed forces) according 
to the approach considered in this paper. 





Figure 2 


Analysis of the graphs presented in Figures 2 and 3 permits one to 
conclude that the method of synthesis and design of a self-adjusting 
two-way system, proposed in this paper and that takes into account the 
total dynamics of the actuating member of the copying manipulator, 
provides a significant improvement of the quality of operation of the 
system with significant and rapid variation of all the load paramters. 
However, the synthesized regulators are rather complex to realize and 
practice. Therefore, one can attempt to simplify self-adjusting 
regulators without significant deterioration of the quality of the main 
operating modes of two-way systems. 


The results of the studies showed that parameters h and ho can be 
disregarded during formation of control law (10) at speeds of motion of 
the working member of the manipulator up to 5 m+s. Moreover, 


coefficients K}m can be adjusted only by the values of H and Jo, but h 


and ho must be included in control law (10). The errors of the 
synthesized two-way system are denoted by the number 3 upon introduction 
of the indicated simplifications in Figures 2 and 3. It is obvious from 
these figures that curves 3 hardly differ from curves 2 for the 
considered operating modes, which correspond to a two-way system with 
accurate and complete self-adjustment for all variable load parameters. 
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Figure 3 


Of course, introduction of the indicated simplifications does not 
guarantee high-quality operation of two-way systems in all operating 
modes of copying manipulators; therefore, the efficiency must be checked 
at all possible motions of the actuating member when using the 
simplified regulator. However, studies and analysis of curves 2 and 3 
permit one to hope that the coefficients of the regulator can sometimes 
be adjusted by only two parameters H and Jp. This considerably 
simplifies practical realization of self-adjusting two-way systems 
without significant deterioration of the indicators of its operating 
quality. 
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[Text] An adaptive robotic complex with robotic 
vision and force-moment sensitization systems has been 
developed for theoretical and experimental studies of 
the problems of using sensory information in control 
of industrial robots. 


Modern experience of practical use of industrial robots (PR) showed the 
need to develop robotic complexes (RTK), oriented toward fulfillment of 
specific manufacturing operations and built into the hierarchical 
structure of the management system of a flexible automated plant. 
Special sttention is devoted to giving these complexes adaptive 
properties to reduce expenditures for organization of the working 
environment and to readjust the manufacturing equipment. 


A number of problems such as interaction of the robotic complex with the 
upper level control system, synchronization of simultaneous operation of 
several robots, processing and utilization of various sensory 
information for control of robots, depiction of the operating 
environment in the form of a model of the external world, planning the 
motions of robots with regard to variations of this model, teaching 
robots and so on must be solved in development of adaptive robotic 
complexes. An experimental adaptive robotic complex was developed to 
conduct theoretical and experimental studies in this field. The complex 
is oriented toward completion of mechanical assembly operations, 
machining, painting and soldering. The work is being conducted in 
several directions. The basic direction is related to development of 
the algorithms and software of robots, sensory systems and the control 
computer of the robotic complex. Much attention is devoted to design of 
multicomponent force-moment sensors and of passive centering devices for 
assembly of mechanical connections. 
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The developed robotic complex includes: a control computer, two 
industrial robots of type RM-01 (PUMA 560), television and photoarray 
robotic vision systems, two force-moment sensitization systems, a number 
of passive centering devices and a lighting system. When studying 
individual manufacturing operations, the robotic complex is delivered 
with additional fittings and tools. 


The central part of the developed robotic complex is an Elektronika 15 
VUMS-28 computer. Connection between separate subsystems of the complex 
is provided by using a serial interface of the Styk S2 type and a 
parallel interface of the IRPR type (see figure). The software of the 
robotic complex supports the following main functions: coordination of 
the joint operation of two manipulators, synchronization of the 
operation of individual subsystems, compilation of industrial robot 
control programs in ARPS language, and loading of them into the 
industrial robot controller (UU) Sfera-36, and transfer of data files 
and control commands of subsystems. 
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Block Diagram of Experimental Adaptive Robotic Complex: 
UU--Sfera-36 controller of RM-01 industrial robot; 
TV--television camera; K STZ--robotic vision system 
controller; FM--photomaster camera; K FM--photomaster 
controller; SMD1--force-moment sensor in base of assembly 
table; SMD2--force-moment sensor in wrist of industrial 
robot; KSMD--force-moment sensor controller; MK SSO-- 
force-moment sensitization system microprocessor controller; 
MTsU--mechanical centering device; S--industrial robot. grab; 
SO--lighting system; TO--manufacturing equipment; EVM VU-- 
upper-level control computer 
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KEY: 


1. Styk S2 interface ll. Lighting system 

2. Styk S2 interface 12. IRPR interface 

3. Robotic vision system 13. Force-moment sensitization 
computer system microprocessor 

4. Robotic complex computer controller 

5. Upper-level control 14. Sfera-36 controller 
computer 15. Manufacturing equipment 

6. Television camera 16. Controller 

7. Robotic vision system 17. Photopattern controller 
controller 18. Industrial robot grab 

8. IRPR interface 19. PUMA 560 industrial robot 

9. Force-moment sensor 20. Photopattern 
controller 21. Mechanical centering device 


10. Force-moment sensor 


The complex is controlled through special commands, written in a 
separate file or introduced by the operator from the keyboard of the 
robotic complex computer in the form of symbolic lines. The Commands 
are executed in the interpretation mode, Studies are now under way to 
develop a robotic complex control language. 


Robotic vision systems (STZ). Two robotic vision systems are used in 
the developed robotic complex: a television and photopattern system. 
The television robitic vision system is designed to identify parts, to 
determine their position and orientation, and also for visual inspection 
of products. It includes a fixed television camera with standard 
television signal, an Elektronika NMS-1201.02 microcomputer, and an 
interface module for the computer to communicate with the camera. The 
interface module enters a frame of the image measuring 256 « 256 
elements and writes it to the computer RAM in a format of 1 bit/element. 
The image is converted to the binary system according to a program- 
assigned threshold having 64 levels. 


The photopattern camera is mounted on the industrial robot grab and is 
used to organize the external feedback according to the position of the 
grab with respect to the object. The pointing function is realized for 
a given moment. Besides a camera, the photopattern robotic vision 
system includes a photopattern controller with integration module with 
the Q-bus of the Sfera-36 controller. An image frame measuring 32 x 32 
elements with 64 levels of brightness is written to the RAM of the 
controller. 


The robotic vision system is programmed to perform a specific operation 
using tool software (PO). The latter consists of universal and 
specialized devices and functions under control of the RAFOS operating 





system. 


The specialized part, which is the core of the image processing software 
in the robotic vision system of an assemb1) 
image analysis and synthesis systems, 


robotic complex, includes 
funetioning modes of the robotic 








vision system and communication modes. The basis of each system is a 
set of libraries that guarantee development and study of visual analysis 
procedures, and also creation of applications software. The analysis 
system includes image shaping libraries (formed by image input and 
output modules), description libraries (modules for construction of 
models, initialization of data structures, analysis of connectedness, 
description of components, formation of a list and image of the model) 
and image interpretation. The image synthesis library includes input, 
primitive, filling and image modules; the communication libraries 
including loading, dialogue and systems subroutine modules; and the 
teaching libraries include mode, statistics and image modules. 


The program modules of the libraries process the images, shaped by both 
television and photopattern cameras. The operating mode of the modules 
is determined by the values of the parametes assigned during generation 
of the robotic vision system software. 


To implement the functions of the robotic vision system, the image to be 
analyzed is represented in the form of an oriented root tree of 
components, i.e., of image domains, corresponding to individual parts or 
fragments of them. Each vertex of the tree representing a component is 
characterized by a set of parameters that determine the absolute and 
relative position and orientation of the component and that guarantees 
identification of it. The “encompassing-embedded component" ratios are 
given between the vertices of the tree. The image is described within 
some window of rectangular or arbitrary shape, and the position and 
dimensions of the window are assigned earlier when teaching the system 
or are determined directly during the manufacturing process. 


The developed a priori glossary of component parameters includes those 
calculated on the set of component elements, contour elements and local 
characteristics, and also a number of relative values, and permits one 
to describe objects of different shape. The developed algorithms permit 
one to use various types of representation of contours and is adapted to 
the shape of the objects, which results in an increase of the speed of 
the system. The algorithms for analysis of the connectedness and 
description of components, used in the system, guarantee processing of 
images of scenes of the assembly processes in real time (1-3 s). 


The main restrictions imposed on the composition of the software of 
industrial robotic vision systems are the low main memory capacity of 
the computer and the need to solve problems in real time with regard to 
the characteristics of the manufacturing process. 


To automate the process of developing the robotic vision system 
software, it is suggested that a hierarchical system be used, the task 
of which includes a flexible interface with operator, information 
support of the decision search process, evaluation of the software as a 
whole and evaluation of individual modules according to the used 
criteria, storage and generalization of the operator’s action and a 
number of auxiliary functions. Each program module is evaluated by the 
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quantitative and qualitative parameters such as processing time, 
capacity of the memory occupied, degree of universality, quality of 
processing and so on. It is suggested that expert analyses be used with 
regard to the possibility of total formalization of parameters. 


Linguistic variables (LP), designed on the basis of odd set theory, are 
considered for design of a system of expert evaluations. A context-free 
grammar of linguistic variables is worked out, which is a group of four 


G=<«\, T(\), U, S>, 


/ 


where N is the number of the linguistic variable, T(N) is the term or 
term-set of the values of the linguistic variable, U is the set of 
values of the basic variable, and S is the syntactical rule for 
formation of the linguistic variable. 


The characteristic feature of the introduced grammar includes the 
universality of the image of both even and interval values and of 
qualitative estimates. 


The criterion of the usefulness of the module within the robotic vision 
system software is an unevenly suspended discriminate function 


where w, is the coefficient of preference of the i-th parameter and ej 
is expert analysis of the i-th parameter. As a result, the 
corresponding values of the preference factors were found for different 
types of robotic vision systems. Variants of the configuration of the 
robotic vision system software were selected and they were generated 
after ranking of the available program modules by the value of the 
utility factor. 


Force-moment sensitization systems (SSO). The experimental robotic 
complex includes two force-moment sensitization systems. The sensor of 
the first system is located in the base of the assembly table and is 
used to measure the components of the main force and moment vector, 
occurring upon assembly of the unit, mounted on the table. Force-moment 
information is introduced and processed in the robotic complex computer 
and is used to check the assembly process and to control the robots. 


the second system is made in the form of a separate design, located 
between the last link of the industrial robot and its grab. The 
controller built into the housing of the sensor guarantees input, 
processing and transmission of the force-moment information in the 
Sfera-36 controller for organization of external force feedback. The 
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1816 VE48 single-chip microcomputer with ROM having capacity of 4 kbytes 
is included in the controller, which permits implementation of 
specialized data processing programs. The indicated programs are 
designed to compensate for the temperature-time instability of the 
measuring circuits, to take into account the static components of forces 
and force moments, caused by the weight of the grab and tool, and also 
to present a system of forces from the center of measurement of the 
sensor to a point, connected to the end executive of the manipulator. 
Location of the controller inside the sensor housing permits one to use 
the concept "intelligent sensor,” according to which force-moment 
information is processed autonomously. This frees to a considerable 
degree the computer resources of the control computer of the robot. 


The force-moment sensors of both systems contain strain gage resistor 
sensitive elements and have diagonal stiffness matrices, which permits a 
level of cross-connections between channels in the range of 3-5 percent 
at speed of the force-moment sensitization system of not worse than 

100 ys. 


Mechanical centering devices (MTsU). Along with force-moment 
sensitization devices, the experimental robotic complex includes passive 
force-moment adaptation devices, realized in the form of mechanical 
centering devices with remote stiffness center. The device is located 
in the wrists of the industrial robot and is designed to compensate for 
the mutual positioning errors of conjugate parts of the "shaft-bushing” 
type due to the effect of forces occurring during assembly. The 
presence of a remote stiffness center reduces the probability of 
jamming. The mechanical centering device is designed in the form of a 
combination of linear and angular pliancy modules, which permits one to 
provide small values of linear and angular stiffnesscs simultaneously 
(up to 1,000 N/m and 6 N-m/rad), and, accordingly, to provide forces of 
interaction of parts at a significant distance of the stiffness center 
of the device (up to 200 mm) from its end flange. The high reliability 
of the device is achieved by using elastomeric structures of directed 
pliancy as the elastic elements, which are subjected to shearing and 
compression, and which do not experience tensile loads. 


The utilized mechanical centering devices contain interchangeable 


modules, having different stiffness and geometric characteristics, which 
permits online adjustment of the robotic complex for assembly of other 


types of products. 


COPYRIGHT: "IZVESTIYA VUZOV SSSR - PRIBOROSTROYENTYE", 1990 
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[Text] The operating characteristics of the force 
sensor of an industrial robot in a technological 
cleaning operation are considered. A mathematical 
model of the force sensor is presented, and the 
operating and working principles of individual 
functional modules of the force sensitization system 
are described. 


Such technological operations as rough grinding, abrasive and milling 
cleaning can be combined into one group of operations of the trimming” 
type. Regardless of the type of material to be machined, the 
characteristic features of this group of operations are the presence of 
random projection and use of a rotating milling tool, which determines 
the dynamics of interaction with the part to be machined. An abrasive 
disk or cutter is frequently used as the tool. Practical solutions are 
implemented slowly with the obvious importance of automating these 
human-hazardous technological operations, which is explained by the 
complexity of the technical task. We in the USSR already have several 
industrial robotic trimming robotic complexes, while industrial robots 
are used extensively in these operations abroad, judging by the 
publications and recent exhibitions. Power sensors are not yet used in 
trimming robotic complexes in the USSR. For example, thermosetting 
plastic parts are trimmed at the Elektrosila Association without a power 
adaptation; the trimming complexes manufactured by NPO [scientific 
production association] Granat are also not yet equipped with force 
sensors. The use of force feedback permits one to develop a trimming 
robot control system, having the highest machining performance, since 
the extent of the projection is indirectly estimated through measurement 
of the cutting forces, which permits one to regulate the rate of 
delivery of the tool along the contour of the part as a function of the 
real value of the projection. The use of adaptation according to the 
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cutting force also increases the safety of trimming and the quality of 
machining. A large number of designs of various force sensors for 
industrial robots are described in the Soviet and foreign literature [1, 
2], but there are no descriptions of force sensitization systems (SSO) 
for trimming robots. 


\ force sensitization system has been developed and manufactured at MGTU 
[Moscow State Technical University] imeni N. FE. Bauman, specially 
designed for trimming operations. The sensitization system has the 
following specifications: 


Number of measured components (total force 


vector at any point of work zone of sensor) 3 
Range of measured forces (for each component), N #50 
\ecuracy by channels, pecent 3, 5, 5 
Maximum frequency of input signal, kHz 5 


The specifics of the given force sensitization system includes the fact 
that the total cutting force vector in the region of contact of the tool 
and part can be measured at any point of the circumference of the tool. 
Since the force vector is measured at a specific spatial region (work 
zone) of the force sensor coordinate system rather than at a fixed 
point, no restrictions are imposed on the diameter of the tool, and the 
given force sensitization system can be used not only with smal l- 
diameter end mill cutters, but also with disk cutters, and with abrasive 
and diamond disks. During trimming, the contact zone of the tool and 
part can be shifted around the circumference of the tool and can 
significantly change its coordinates, which will not essentially affect 
the measurement of the force vector components. 


\ block diagram of the force sensitization system of a trimming robot is 
shown in the figure. According to this layout, several force 
sensitization systems have been manufactured at MGTU imeni N. FE. Bauman 
for different types of robots. Let us consider in more detail a version 
of a force sensitization system for the RM-0O1 industrial robot with 
PUMA-NOKTA electromechanical actuating device. The force sensitization 
system consists of three functionally complete modules: a force sensor, 
a force data input card and a program module, which additionall) 
processes the force signal. 


The force sensor is a structurally complete product, included in the gap 
of the force circuit between the mounting flange of the robot and the 
working tool (a pneumatic turbine with cutter). The force sensor 

4 
measures the cutting force vector F, which occurs in the contact region 
of the tool and part, and emits in analog form three components of the 
cutting force in the coordinate system of the sensor. KF-5P foil strain 
gages with base of 2 mm and with rated resistance of 200 ohms are used 
as the sensitive elements. The principle of structural separation of 
force factors, similar to that presented in [3], is used in the 
considered sensor. But the force sensitization sensor, designed on the 
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basis of the sensor developed at MGTU imeni N. E. Bauman, also has new 
properties, manifested in measurement of forces exactly on trimming 
operations. 
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Block Diagram of Robot Force Sensitization System 


KFY : 
1. Force sensor 9. Address decoder 
2. Force data input card 10. Program module of additional 
3. Central processor force signal processing 
4. Computer 11. Channel transceivers 
5. Multiplexer 12. Sensitive elements 
6. Robot software 13. Channel of robot NP device 
7. Preamplifiers 14. Flexible elements 
8. Analog-to-digital converter 


— 


The primary signal vector of the sensitive elements R, the dimension of 
which is determined by the selected number of measuring points, is 
introduced to analyze the conversion of data in the force sensor. Each 
component of the vector R is an electric signal, taken from the 
measuring circuit of strain gages, glued to a specific region of the 
flexible element. The strain gages are ordinarily connected by the 
measuring bridge or semibridge layout, which affects only the level of 
the removed signal and does not affect the functional conversion of the 
signal; therefore, let us assume that a bridge or semibridge is one 
generalized sensitive element, which measures deformation at one point 
of the surface layer of the flexible element. Let us also introduce the 
relative deformation vector E, the components of which are the relative 
deformations of the surface layers of flexible elements at the measuring 
point. With regard to the assumption that one generalized sensitive 
element measures deformation at one point of the surface layer of the 
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~~ 


flexible element, let us take the dimension of vector E, equal to that 


= ~ = 


of vector R. Vectors E and R can then be linked by the matrix of the 
transfer coefficients of sensitive elements B by the relation R = BE, 
where matrix B is a diagonal B = diag[bi1, be2, b33, bas, b55, beg], and 
its elements are constants, determined by the coefficients of the 
strain-sensitive strain gages, by their connection circuits, and also by 
the power supply voltage of the bridges. The sensor generally measures 


_ 


the total vector of force factors G, consisting of the principal vector 
F and of principle moment M, reduced to the measuring center of the 
sensor: 


If the matrix of sensitivity of the flexible element of sensor A is 


— 


introduced, the vector of relative deformation E will be determined as 


— ——s 


E = A-G. 


One can assume for most trimming operations that the contact region of 
the tool and part is small! and can be considered as a point. The main 
principle of the force sensor is that its measuring center is mobile and 
coincides with the contact point of the tool and part. The main moment 
of external forces is equal to zero with respect to this point and the 


- 


total vector of the external force factors G, measured by the sensor, 
will consist only of the principal vector F, i.e., its dimensionality 
will be equal to three. The dimensionality of the primary signal vector 
of sensitive elements R and accordingly of the relative deformation 
vector E in the sensor is equal to six, i.e., to the number of selected 
measuring points. This is determined by the need to measure, besides 
the three components of the force vector, three additional coordinates 
of the movable contact point of the tool and part. The sensitivity 
matrix of the flexible element of the sensor A is thus rectangular with 
dimensionality 6 « 3. the primary signals of the sensitive elements are 
amplified by the pre-amplifiers, i.e., vector R is transformed to signal 


_ 


vector S = CR, where C is the diagonal matrix of the force factors of 
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pre-amplifiers, and C = diag[c;;, C22, C33, C44, C55» Cég]. After the 
six-dimensional vector S has been processed by the computer, a three- 

- = 
dimensional vector of the measured force U = DS is found. Here D isa 
rectangular 3 x 6 matrix of the computer. Complete transformation of 
the data by the force sensor can be expressed by the relation U = HF, in 
which H = DCBA. 


The considered sensor has a sensitivity matrix of the flexible element A 








a, 0 OF 
a. 0 0 
4—|9 ax 0 (1) 
0 ag 0 
0 0 as; 
10 0 aI 
and computer matrix D 
d, 42 0 0 0 O 
D=]0 U a». A>, 0 0 , (2) 
0 9 0 0 @,, dy 


Expressions (1) and (2) show an ideal type of matrices A and D, since 
realistically all the elements of the indicated matrices may not be zero 
matrices, which results in a mutual effect between the channels and an 
increase of the total measurement error. As the test results of the 
sensor showed, the measurement error with regard to the reciprocal 
influence of the channels does not exceed 5 percent in the temperature 
range of 15-30°C--this is sufficient to design an adaptive force control 
system of a trimming robot. The flexible element of the sensor is made 
of 40Cr steel, subjected to heat treatment, and consists of three 
assembly units, pinned during assembly. The flexible element can also 
be made a unit element, but this complicates the manufacture and 
subsequent gluing of the strain gages. The overall dimensions of the 
sensor (60 x 65 x 80) essentially do not limit the service angles of the 
actuating device. The developed design is technologically effective, 
but imposes high requirements on the accuracy of the production 
equipment and can be manufactured at any plant. The electronic part of 
the sensor consists of an additional internal stabilizer, 
pre-amplifiers, and a computer, realized on 153UD5 operational 
amplifiers. 


61 





The force data input card is made in the design of the Sfera-36 
controller and is a specialized high-speed multichannel analog-to- 
digital converter. The input card is connected to the force sensor by a 
cable, through which power of #15 V is fed to the sensor and three 
analog signals, corresponding to the components of the measured cutting 
force vector F, are received. A shown in the figure, the basis of the 
force data input card is an analog-to-digital converter, realized on a 
K1107PV1 integrated analog-to-digital converter. The high speed of the 
analog-to-digital converter and of the K590KN6 multiplexer guarantees 
switching of the required channel and subsequent analog-to-digital 
conversion within time less than 10 ys, i.e., less than the maximum 
permissible delay of the “Response” signal of the passive device on the 
channel of the central processor. This permits one to do away with an 
internal data buffer, and the central processor immediately reads the 
code of the converted value from the analog-to-digital converter. The 
input card in the address space of the central processor has three 
addresses, and each address corresponds to its own channel (the 
component of the measured force vector). After decoding the address, 
the multiplexer switches the channel corresponding to this address and 
starts the analog-to-digital converter, which emits the received code to 
the data address bus through the channel receivers after completion of 
conversion. 


Final processing of the force signal occurs in the program module for 
additional processing of the force signal (see figure), which solves the 
following tasks: it filters the low-frequency noise component, switches 
the force signal, compensates for the gravitational component of the 
force signal and determines the emergency situation. Commutation of the 
force signal guarantees that it will be disconnected for the time of 
completion of transport operations. Compensation of the gravitational 
component of the force signal eliminates the effect of the weight of the 
tool as a function of its orientation in space. The program module for 
additional processing of the force signal operates under control of 
modified ARPS language of the RM-01 robot. 


The tests of the developed force sensitization completely confirmed the 
operating principles, embedded in all its functional modules. A set of 
technical documentation, which permits duplication of it for use in 
trimming complexes based on the RM-01 robot, has been developed for the 
sensitization system. 
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[Text] The problem of synthezing a system for 
recognition of the final number of images given by 
their brightness functions is considered. A procedure 
for determination of the location of the sensors and 
of designing a specialized computer for recognition of 
plane images is described. Examples of designing 
robotic vision systems, based on the given recognition 
system, are outlined. 


One must solve diverse recognition problems when developing sensitized 
industrial robots. These problems are ordinarily solved by using 
integral [1-5] or contour [6, 7] methods. However, integral methods 
require reading of the entire image, while contour methods require 
reading the contour images, which leads in the first case to complex 
technical realizations and in the second case to low noise stability. 


The proposed method is applicable for recognition of a finite number of 
images, given by their brightness functions. It permits one to 
synthesize m ¢ n sensors and a specialized computer, which, processing 
data from the sensors, performs the recognition, by the brightness 
functions of n images. 


Operating principle of recognition system. Let on set X be given n 
mutually different functions f,;:X - R (i = 1...m), further called 
brightness functions. One of the brightness functions is represented. 
It is required to know which function. 


Let us denote by x the point of set X and let us determine the image 
F:X ~ R® by the matrix equation 





F(x) 
F(X) = 
F(x) 


Let us call system of points x!...x™ of set X the separating system, if 
the rows of matrix [F(x!)...F(x™)] are mutually different. 


Let us synthesize a recognition system, formed of sensors and a 
specialized computer, in the next point by matrix [F(x!)...F(x™)], and 
let us describe the operating principle of this system. 


Let us assume that x!...x™ is the separating system and let us show how 
it is proposed to solve the postulated recognition problem. Let f be 
the imposed brightness function. Let us form a row [f(x!)...f(x™)], 
corresponding to one of the rows of the matrix [F(x!)...F(x™)], for 
example, with the i-th row. In this case f = fj and, accordingly, the 
brightness function is proved. 


Let us show that there is a separating system, formed of m ¢ n points, 
in set X. If the vectors F(x!)...F(x™) form the basis of the linear 
subspace, generated by all vectors of type F(x) at points x!...x™, the 
system of points x!...x™ will be the separating system. Let us present 
the proof by the method of the opposite. Let us assume that rows with 
numbers i and j coincide in the matrix A = [F(x!)...F(x™)]. There is 
the vector y € R™ at which F(x) = Ay for any x € X by specific points 
x'...x™, Therefore, fj(x) = f;(x) at all x € X, and this can not be, 
since the brightness functions were assumed mutually different. This 
means that the system of points x!...x™ is the separating system. 


The inequality m ¢ n is obvious. 


Technical realization of recognition system. The values of 
f(x!)...f(x™) of brightness function f must be calculated at points 
x'...x™ of the separating function to realize the described recognition 
method. This can be accomplished by using sensors that operate in the 
following mode: 


5, . ! at 
| at 
where q = 1...k, A is an input signal, ;..;,. <3}, are the 
quantification levels, and 4,...4, are output signals. The necessary 
sensors are designed by matrix columns [F(x!)...F(x™)] and includes 
selection of quantification levels 4 ._.{ and of their number k) 
(j = 1l...m). 
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be the different elements of column F(x)). 


/ / ay , 
Let us assume that “1 =}... Api —uh/) as the quantification levels of 


the j-th sensor. The number of Kk) is a unit less than the number of 
different elements in column F(x)). Let us denote the input signal by 


A) and let us denote the output signals by 4{... afi 


A block diagram of the recognition system is shown in Figure 1, where 
D'...D™ are sensors and SV is a specialized computer. 


The specialized computer performs the function of decoder: if signals 
Al = f,(x!)...4m™ = fj (x™) are fed to the inputs of sensors D!...D™, the 
i-th output signal of the computer is equal to one, and all remaining 
signals are equal to zero. 


To design this computer, let us be given the constant 


ey |) at fie) <a, 
IT 10 at | iv SA, 
and here i = 1...nm, j = 1...m, and q = 1...k). 


The computer that realizes the output signals 7,...7p by the formula 


where i = 1...n, while ® is addition modulo 2, operates in the required 
mode. 


It should be noted that a perturbed function f + g, where g is noise, 
rather than an ideal brightness function f is fed to the inputs of the 
sensors in engineering problems. Therefore, the problem of protecting 
the recognition system against noise occurs. This problem can be solved 
by selecting the values of the quantification levels of the sensors. 

Let us be given the number 


| 
7, min min (ug.,;— ul) 
J-My—g jd 
and let us use as the quantification levels the values JJg = pJq + €, 
Where j = 1...m, and q = 1...k). The recognition system is protected 


against noise that does not exceed the number ¢€ in absolute value at 
these quantification levels. 
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Moreover, the brightness functions f;...f, are not « .wlly probably 
manifested in engineering problems; therefore, the ;.oblem of providing 
the required probability of correct operation of the recognition system 
arises. This problem is solved by increasing the number of sensors and 
of modifying the specialized computer. Since the description of the 
general solution is rather cumbersome, it will be illustrated further on 
the example of a specific problems. 


Fxamples of synthesis of recognition system [8]. The described 
recognition system was technically realized in different modifications 
for recognition of large parts of the K701 tractor, for determination of 
the orientation of nonmagnetic conducting parts, when designing the 
robotic diesel painting complex, to determine the position of the parts 
in the cold stamping section, and when designing the recognition systems 
and a nondestructive quality system, Photosensors, inductive and 
strain-gage sensors, and gamma-radiation sensors were used in developing 
these systems. Specialized computers were realized in all systems on 
microcircuits of series K153 and K155. 
The proposed method will be illustrated on examples of design of flat 
part recognition systems. 


Example 1. Flat part recognition systems. Let us determine the 
brightness function f(x) of a flat image GC R*. Let D(x, r) bea 
circle with center at point x and with radius r, and let p(A) be the 
area of section A. The brightness function f of image G is given on set 
KX = R° and is determined by the formula 


; ulGf D(x, ry} 
fir) nO 


U 





Constant ris the radius of a circular section, from which the sensor 
perceives information. The brightness function f is similar to the 
characteristic function of set G, equal to one at G and equal to zero 
outside G, at small r. 


The brightness fucntion f is measured by sensors operating in the 
following mode: 


Let us consider examples of synthesizing a system for recognition of the 
positions of a fixed part (variant 1), parts with one degree of freedom 
(variant 2), and parts with two degrees of freedom (variant 3). The 
part has the shape of an angle in all cases. 
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Variant 1. If the part 1 is transported by belt conveyer 2 (Figure 2, 
a), It begins to be rotated due to friction forces upon approach to stop 
3. It is clamped by jaws 4 after completion of rotation for fixation of 
the part and occupies one of three positions, shown on Figure 3, a. In 
this figure, axis X proceeds along the stop, while axis Y proceeds along 
the left jaw of the grab. The superimposed contours of the positions of 
the part are shown in Figure 4, a. 























Figure 1 
KEY: 
1. Specialized computer 
a =| 
m mr 
| { 
we | | 
_ "| ! 
b 20 
-y 
_— { 
| 
Figure 2 


Let f;, f> and f3 be brightness functions of plane images, shown in 
Figure 3, a. Let us assume that constant r is sufficiently small. In 
this case, points x! and x”, shown in Figure 4, a by the asterisks, form 
a separating system. 


Matrix [F(x!), F(x2)] will have the form 
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Accordingly, the specialized computer should realize the following 
output signals to recognize the positions of the part 


T) = 6,8, 
2= (S6,8] ) do, 


T3=6, (S81). 


If P is the probability of correct operation of the sensor, the 
probability of correct operation of the synthesized recognition system 
will be Py = p2, 


Let us place additional sensors at points x3-x§, shown in Figure 4, a by 
the asterisks. The specialized computer that realizes the following 
outpuc signals 


1] f 


“> @ n (6, 8C‘,;) 





R=| jum) 
where i = 1, 2, 3, while 11 « 6 matrices c!, c?, and c3 
rOo0d01]111y F1I1100014 ri lilioy 
,100111 lL11011 t11100 
Olli) 1 11100) 101110 
01011 1 110101 101101 
010110 110011 101100 
001111 110010 101011 4, 
(00101 1 110000 101010 
"000110 100001 101000 
FQOO00101 011001 100100 
00001 1 010001 011100 
900010 0}]000 0 001100 




















guarantees the probability of correct operation of the recognition 
system P.=p'+6p (l—p)-+4dp'il—p)-. At p > 0.54, the probability P» > P;. 


Therefore, the second recognition system operates more correctly. 
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Figure 3 


Variant 2. Let part 1, as in the first case, be transported by a belt 
conveyer 2 (Figure 2, b), but after rotation near stop 3 is not squeezed 
by the jaws. To determine the position of the part, let us place 


sensors 5 on push rod 6, having the possibility of forward displacement 
parallel to the stop 3. The mutual arrangement of points x!, x2, and x3 


of the sensors is shown in Figure 4, b. The matrix [F (x'), F (x*), F(x’) ] 


has the form 


therefore, the output signals of the specialized computer are 


Tt; = 6606s, 
To= (6;81) (6.81) ds, 
™3= 6; (6.81 ) bs. 


70 








We note that the sensors placed at points x! and x? determine the number 
of the position of the part, while the sensor located at point x3 
determines its displacement with respect to the stop. 


Variant 3. Let the part be arbitrarily located on a plane. Let us link 
coordinate system XY to the plane (Figure 3, b). Let us measure the 
coordiantes (X;, Y:) of the topmost and (X2, Y2) bottommost vertices of 
the part (the possible ambiguity is easily eliminated). This 
measurement can be made, for example, by using an integral photodetector 
array. 








Figure 4 


Six possible positions of the part, when its different vertices are the 
upper or lower, are shown in Figure 3, c. 


Knowing coordinates (X;, Y;) and (X9, Yo), let us transform the 


coordinate system so that the equalities X¥,=Y,=Y.=0 are fulfilled in 


~~ 


new coordinate system XY. The contours of all six images can then be 
combined in the new coordinate system, as shown in Figure 4, c. 


~ ~ ~ 


The points of placement of sensors x!, x2, and x3 are shown by the 


~~ 


circles in Figure 4, c in coordinate system XY. Let us apply the 


inverse transform of coordinates to points x!, x?, and x3 to determine 
the coordinates of cells x', x?*, and x* in the photodetector array, from 
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which the information must be read. Regardless of the transformation of 
coordinates, matrix [F(x!), F(x?), F(x%)] will have the form 


110 4 


10 0 
yo. 0 


O11 
00 1 
Li) O oq 








Accordingly, the specialized computer should realize the following 
output signals 


tT; = 6;6.(6381), To = 6; (6281) (6,81), 
t3= (6;61)62(6:81), t= (5;81) 606s, 
t= (i@1) (6@1)ds, t= (691) (621) (6,81). 


Example 2. Recognition system for three-dimensional parts. Let us 
determine the brightness function f of a three-dimensional image G C R?3. 
Let X = R3 x S?, where S? is a unit sphere. Points X of set R® « S? are 
pairs (x;, X29), where x; is an arbitrary vector and x2 is an arbitrary 
unit vector, which controls the direction. Let D(x, r) be a circle with 
center at point x; and with radius r, located in plane a, perpendicular 
to vector x9, and let 7(x;, G) be the orthogonal projection of the body 
G onto plane 4. The brightness function f of the image G is determined 
by the formula 


u | (xX, G)ND (x,, ‘4 


ed an 
eel 





f(x) = 


The sensors that measure brightness function f operate in the previously 
described mode. 


Figure 5 





Figure 6 


Let us present a system for recognition of 12 parts of the K701 tractor, 
moved by an overhead push conveyer. Some of these parts on the conveyer 


are shown in Figure 5. The points x!=(x,!, x5!), x?= (x;2, x2), x9= (4,5, x5), 
xi= (x), xo*), X= (4, 8°), which form the separating system, are shown in 


Figure 6 [8]. 
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[Text] A mathematical model of a strobe pointer 
television system is proposed. The effective noise on 
the operation of the system in the steady mode is 
considered. The operation of a two-circuit system 
with connection between channels with a light- 
scattering layer in the working space was analyzed 
within the model by the statistical linearization 
method. 


A strobe pointer system can be used in robotic visual sensitization 
problems as the sensor of information about the coordinates of the 
object under noise conditions, caused by the presence of a light- 
scattering layer in the working space of the system [1]. A narrow 
visual field permits one to reduce the effect of scattered emission and 
thus to enhance the contrast of the tracked object. The mathematical 
model of an optical angle coordinator, based on the strobe pointer 
principle, is proposed in the article for operating in the presence of a 
light-scattering layer in the working space of the coordinator. The 
system, shown in Figure 1, operates on the closed cycle and has two 
control circuits--an external circuit, closed by the television camera 
rotational drives, and an internal circuit, closed by the strobe 
generator. The problem of the internal circuit is to keep the strobe 
pointer on the image of the object. 


The length of the image along the horizontal and vertical is denoted by 
é, and 6, (Figure 2). In modern systems, the dimensions of the "window" 
are automatically adjusted to the dimensions of the image; therefore, 
let us further assume that the horizontal length of the window is equal 
to @%, while the vertical length is @). The errors lx, and ly between 
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the axes of the "window" and the axes of the image will be small, if the 
center of the image is located near the origin of the television screen. 


The nature of the signal at the output of the television receiver within 
one line is shown in Figure 3. The signal from the source is perceived 
on some background, the mean level of which is denoted by Up: The 


1 


amplitude, i.e., the maximum value of the signal with respect to Uy is 


denoted by A. Each signal in the line is normalized by a limiter, at 
the output of which a square-wave signal is formed with amplitude Up, 
the level of which is determined in the background level estimation 
circuit [2]. 
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Figure 1. Structure of Television System: 
TVK--television camera; TVP--television receiver 
with image scanning; M--monitor; OD--optical 
discriminator; UF--amplifying and filtering elements; 
SZ--delay circuit; GS--strobe generator; P--delay time 
to voltage converter; PP, and PP,y--drives for rotation 
of television camera through coordinates x and y 


Monitor 


oO 


1. Television camera 


2. Television receiver 6. Dela; time to voltage 
3. Drives for rotation of converter 
television camera through 7. Strobe generator 
coordinate y 8. Optical discriminator 
4. Drive for rotation of 9. Delay circuit 
television camera through 10. Amplifying and filter 


coordinate x 


elements 


Each of the four strobes shown in Figure 2 ‘cuts out” part of the image 
falling into this strobe. Four voltages Ug;, Ug», Ugss and Ugas 
proportional to the mean values of the quantified signals impinging on 
the corresponding strobes, are formed at the end of the frame. 
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Figure 2. Screen of Television Monitor With 
Coordinate System x, y: 

a, b--coordinate system of strobe pointer; 
1-4--numbers of strobes 


For example, let errors lx and ly lie in the limits 0 ¢ |1lx| ¢ 0.56% and 
0 < [ly | < 0.56). It is this case of the image that is in Figure 2. 
The averaged voltages in the strobes are then equal to 


{ 7i— (l T,.) 0,58, -0,57,; 

Ueo= (Up Tx) (0,50,—/x)0,5ny; (1) 
Ul as = { [’ T } (0.50.—l~) (05n,—? Uy) & 

LU g= (Uo 1.) 0.58, (0,52 ,—j (ly), 





where Ty and To are the time of the frame and line scanning, 


respectively, ny = @,/Tp is the number of lines in the "window," and 
f(ly) is the function ly, which denotes the maximum integer, close to 
the ratio ly/To. The error voltages are generated by the laws 


Uy = (Ug: + Ug2) — (Ugs+ Ug). (2) 


Generalizing expressions similar to (1) and using (2), one can write the 
following formulas for the discrimination characteristics (DKh): 





er ( (Uy Ts.) (ny— lf Uy) |) ex: 0< |/.]<0,58., ' 
Kec (le) = 1 (Us Ta) (Ox—| le |) (ny— | FL) |) sgn be: 
0.50-<|l|<Ox: (3) 
Keg(igy = {Ui Tad i ly) (Os— [el 0<|!,|<0,58,, | 
su = ) (UL Ty) (Oy—|F Uy) |) (Ox—] ee] sgn ft (ly); 
0.50,<} l, <8y. } 


It is obvious that the continuous error function ly is located along the 
horizontal (line) coordinate of the discrimination characteristic, while 


7] 





the dependence of the discrimination characteristic on the error is a 
discrete step function along the vertical (frame) coordinate. 


The conversion factors KP (the characteristic slope) of the channels of 
the discriminator are found from (3) 


—— ‘T pid j fy 


fr 
| 
| 


(4) 


It follows from (4) that there is a dependence between the channels of 
the discriminator through their conversion factor, which is manifested 
stronger, the greater the value of the errors. 


Let us now consider the effect of noise on the operation of the system 
in the steady mode. The presence of the noise component of the signal 
at the input fo the receiver is shown in Figure 3. Let the mean noise 
output (dispersion) by time with respect to the background level UY be 
equal to Pa The effect of noise reduces to variation of the moments of 
response of the threshold device t; and ta. As a result of the internal 
noise of the receiver, the lengths of the pulsed signals in the strobes 
become random and random components appear in voltages Ug,-Ug; that also 
lead to the appearance of fluctuating components at the input of the 
discriminator. Let us find the value of the spectral densities of these 
fluctuations at zero errors ly, = ly = 0. Consideration of the 
instability of the response of the threshold circuit is described in 
[3]. The dispersion of the instability of the length of the pulse front 
is approximately equal to D = Py? where a is the characteristic slope 


of the signal pulse in the region of threshold level Up [4]. This value 
can be taken into account in the following manner. With triangular 
shape of the signal with amplitude A, a = 2A/@,. Variation of the 
characteristic slope with a different shape of the pulse is denoted by 
coefficient @: a = 2aA/@,. The dispersion of the instability of the 
pulse length will then be 


Let us call the signal/noise ratio q = A*/P.. The dispersion is then 





Since there is 0.5n, lines in each strobe and since the front of each 
pulse in the line fluctuates statistically regardless of other lines, 
the dispersion of each of the voltages Ug;-Ug; will be equal to 
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Figure 3. Signal at Output of Receiver 
Within One Line 


When voltage U, and Uy are formed, all four signals Us, are added 
algebraically; therefore, the dispersion of the amplitude of each of the 


voltages will be fourfold greater, i.e., _“.. Since the error 


voltages Uy, and Uy are filled for the period T, of scanning the next 
frame, the fluctuation component forms a sequence of square-wave pulses 


with statistically independent amplitudes (dispersions D). 


For the subsequent narrowband actuating part of the system, this process 
] 
i 


can be considered white noise with the spectral density 


If the value of the conversion factor of the line channel i: written in 
the form 


and if the multiplifier Ugn,/T n the conversion factor of the 


actuating part of the system is taken into account, the parameters of 
the discrimination characteristi f the line channel will be equal to 
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Figure 4. Block Diagram of Television 
The scattering layer in the working space of the 


of 
therefore, 


the optical signal at the input 


decrease 


is taken into account by introduction of coefficient 
is the signal/noise ratio in the absence of a scatte 
spectral densities of the noise components in the 11 
channels will, sccording to formulas (5) and (6), be 
proportional to coefficient 9: 
N N 
N ‘ d 
a “ ’ Ny 
where Nyg and Nyg are the spectral densities of nois 


system 


to a decrease of the signal/noise ratio q. 


(6) 


Discriminator 


leads to a 


to the system and, 


lf 
§ = q/qo, where qo 
layer, the 


this decrease 


ring 
ne and frame 


inverse] y 


(7) 


e in the line and 


at 


frame channels, respectively, are determined by formulas (5) and (6) 

\ Q = Qo 
Let us carry out further analysis, assuming that a const. If the 
useful signal is determined by a non-scattering Component of source 
emission, the characteristic slope of the signal pulse will not be 
dependent on scattering and coefficient @ can be considered constant. 
Of course, when the optical coordinator operates on the scattering 
component, coefficient @ will vary as scattering increases in the 
located space due to variation of the intensity and due to an increase 
of the spreading surface of an image of a light spot. However, this 





does not alter the methods of analysis of errors in the system, so that 
one Can assume that variation of coefficient J includes not only 
variation of the signal/noise ratio, but also variation of the 
characteristic slope of the signal pulse due to scattering. Comparison 
of formulas (4) and (7) shows that an increase of the error is 
equivalent to a decrease of signal/noise ratio for a strobe pointer 
television system. 


As one can see from expressions (5) and (6), there is a relationship 
between the discriminator channels through cofactors (1 - \f(1y)|/ny) 
and (1 - [1x |/@x). As a result, the block diagram of the television 
discriminator assumes the form shown in Figure 4, where é,y and éy are 
white noise processes. . 


A two-circuit interconnected system can be analyzed in two steps. In 
the first step, the properties of only the internal circuits are studied 
with regard to the relationship between them, and in the second step, 
the system as a whole is studied. Let us consider the method of 
calculating the fluctuation errors in the system shown in Figure 1, 
under the following conditions: the work proceeds on linear sections of 
the Giscrimination characteristic, the number of television scanning 
lines, required for the dimensions of the image along the vertical, is 
greater than 20, which permits one to disregard quantization of the 
signal by the level in the frame channel of tracking and to assume that 
its characteristics are continuous functions. Let us use the 
statistical linearization method to analyze this system in the steady 
mode [5]. 


Since only the fluctuation effects f(t) and §,(t) are taken into 
account in the form of white noise, tracking errors l,x(t) and ly(t) will 
be random processes with zero mean value and variance Dix and Diy. Let 
us find the statistical linearization coefficients for a system with a 
block diagram shown in Figure 4 by the equations 


2Diy 
R, x ] — Ro, (D,, /y | 
l 8 
75, | (8) 
kyy =1- | ~~ = hy (Dig), 


in which it is taken into account that the mean values of the tracking 
errors are equal to zero in the expressions for normal probability 


dens it ies. 


Using the Parseval integral, let us write the variance of errors in the 
steady mode [6]: 


Dix - N's fa. Diy, = Nyly, ( 9 ) 
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where I, and Iy are Parseval integrals for transfer functions of the 
errors of the line and frame channels, respectively. Relations (9) form 
a system of two equations, connected by coefficients ko, and koy. Since 
the Parseval integrals I, and Iy can be found in explicit form, (9) with 
regard to (8) forms a system of nonlinear algebraic equations, which is 
solved numerically or graphically. 


Further analysis concerns study of a television-optical location system, 


developed by V. V. Vasilyev [1] and having the following 
characteristics: transfer functions of the internal circuits 


K,(P) =k,/p, Ko(p) =Re/p; 


transfer functions of the external circuits, containing DC electric 
motors 


R. 
Pp (1 + p73) 








K;(p) = , Kylp)= 


P(l+ py) 


As the experiments showed, the mean square values of the tracking errors 
are on the order of several angular minutes. This means that the signal 
to noise ratio under conditions of a clean atmosphere is qo > 5. Based 
on (8) and (9) for internal circuits, we arrive at the following system 
of algebraic equations: 


N phy Deo / 2D, - 
ean mee e( VE) 
y (10) 
Nuk Dy, 2D —1 
D.. « —— = 0 _ / 2Dix 
* Roy P | V nO | 


here Dxyo and Dyo are the variants of the errors in the channels of the 
system without regard to cross-correlation between channels and in the 


absence of a scattering layer. 


Graphical solution of system of equations (10) is presented in Figure 5. 
We find solutions of them at the intersection points of A and B of 
curves 1 and 2. According to the condition of the problem, the desired 
point is point A, since the values of Djx and D)y increase only for this 
point as Dxo and Dyo increases. At some values of Dxo and Dyo, curves 1 
and 2 cease to intersect, and this means that the system lost stability 
due to cross-correlation of the channels. 
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Figure 5. Graphical Solution of System (15): 
l--graph of function DIx = f(Dly); 2--graph of 
function Dly = f(DIx) 


It is more convenient for practical calculations to use the relative 
values of the variance of errors in formulas (10) 


N ; Di. ] iS}. - 
°*=—D. =—(1--/ —=Ayay} | 


(11) 





Diy 7 fo —— fh l 


/ 
where 


Ax =D4x0/0x", Ay=Dyo/6,?. 


Let us present the analytical solution of equations (11) for the special 
case when the parameters of the channels are identical. It is obvious 
that here A, = Ay = Apo and 6, = A, = &, At some value of & and at given 
parameter Ao, we calculate 





and we find coefficient § as a function of the variance of the random 
component of the error in the channel: 


) l. 
B= (f6)-'; (12 





6 is determined by formula (11). The dependence of the variance of the 
error in the channel on coefficient §, calculated for different values 
of parameters Ao, is shown in Figure 6. The errors in the system 
increase strongly at the same values of § as Ap increases. Analysis of 
expression (12) shows that disruption of tracking in the channels of the 
internal circuit begins at variance of error in the channel of é = 

= 27/9Ao. Therefore, curve 6(4) breaks off at Ao = 0.1 in Figure 6, 
when § = 0.43, i.e., at the moment of disruption of tracking, and an 
increase of the variance of the error begins even with an increase of 
the signal/noise ratio (the dashed curve in Figure 6). 
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Figure 6. Dependence of Variance of Random Component 

of Error in Channel! for One-Circuit (Curves 1-3) and 

Two-Cirecuit (Curves 4, 5) Systems on Coefficient 9; 
the Dashes Correspond to Experimental Results 


The method described earlier is applicable for analysis of a two-circuit 
system--only the structure of the transfer function is complicated. The 
transfer function of the error of the first channel has the form 


Riko 


K ix (Pp) = bk, rkyk3 + pk rk} + p*( | Ro Ry T3) ~ p3T, . 


Let us find the Parseval integral of this function and let us find the 
next expression for the variance of the error of the line channel: 


\ Ry + Ro gk Ts) 
‘ie = =StCi‘ ®’ 8S ne _ >" 4 dy 
hie (Ry kyTs —RaT, + 1) 


The expression of the variance of the error for the frame channel is 
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D,, =N, : 
5 Diy (Hoya? y — Ty +1) 


These equations can be solved graphically. Let us carry out specific 
calculations, assuming that the parameters of the channels are 
identical; therefore, D), = Djy,. 


If there is no light scattering (J = 1) and if there is no relationship 
between the channels (kox = 1), the variance is 


k, (1 + &,T3) 
Dy» = ND (ki 73 — &3T3 + 1) 





Taking (7) and (8) into account, 





. o- Diy _ 1 (1 + Rork, 73) (k} 7. — kyT3 + 1) (13) 
Ror (Ry ATs — kT, + 1) (1+&,7,) , 


a 
k,, =1—- V —,A,, (14) 
where A, =Dxo = /0x°, the same as for a one-circuit system. 


One can find a clear relationship between Kn, and 6, from equation (14) 
at some parameter of Ay, and one can calculate Ko,(4é,) for the selected 


value of é¢,, while one can calculate 


(1 + Ry yk, 73) (Ry 13 — R373 + 1) 
Ro (RAT, kT. - ly kT.) (15) 


the dependence of the variance of the error on the coefficient of 
statistical linearization in the absence of a scattering layer at some 
parameters of k;, k3, and T3 for the derived value of kox. According to 
(13), 


B=f[/6x, ( 16) 


here 6, is the earlier selected value of the relative variance of the 
error. Relation (16) establishes the dependence between the relative 








variance of the error and the coefficient of variation of the 
signal/noise ratio and permits one to calculate function 4,(9). 


Let us perform specific calculations at k; = 500 s~!, kg = 200 s"!, Ts; = 
= 0.2 s, Ay = 10°3 and A, = 10-2. The functions 4,(9) for a two-circuit 
tracking system is shown in Figure 6 by the dash-dot lines. The nature 
of function ¢x(9) is the same as that for a one-circuit system; the 
variance of the error increases rapidly as A, increases. The greater 
A., the earlier disruption of tracking begins and it is expressed in the 
form of an increase of the variance of the error as coefficient J 
decreases. The errors at the same values of J are greater for a 


two-circuit system than in a one-circuit system at A, = As. Moreover, 
system of equations (14) and (15) generally has no solution that 
satisfies the physical meaning of the problem at A, = 10°!. The values 


of formula (16) are greater than unity in this case. 


It is shown in Figure 6 that the values of @; are small at 9 = 1, i.e., 
the relationship between channels in the system is weak in the absence 
of a scattering layer. For example, if Ay = 10°, then koy(J = 1) = 

- 1.06. Thus, the relationship of the channels upon transition from a 
one- to a two-circuit system is intensified. 


The mathematical model of a tracking window television system was 
checked experimentally on a laboratory unit. 6-3N and 8-3N neutral 
light filters, initially calibrated on a spectrograph, were used to 
attenuate the light signal. The fluctuation component of voltage was 
taken by using an oscillograph at the output of the discriminator. The 
resulting experimental values (the dashes in Figure 6) are easils 
described by a model function at Ay = 1.4°-10°2. We note that the 
probabi ity of disrupt ion of tracking, observed in experiment, was O.D 
at J = 0.28 (8-3N light filter). 
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[Text] Problems of pre-processing of mult igradation 
images of typical assembly scenes are considered. A 
context-free grammar of a linguistic variable is used 
to formalize the concept "BRIGHTNESS." It is 
suggested on its basis that the brightness scales be 
converted and that the images be segmented. 


Information about the course of the manufacturing process must be 
obtained and processed under conditions of a flexible automated plant. 
The type of information systems is selected as a function of technology. 
Analysis of typical robotized assembly operations showed that a robotic 
vision system (STZ) has the greatest information content. It permits 
one to determine the position, orientation and characteristic dimensions 
of the assembly unit and of individual parts, and also to transfer this 
information to the robot control system. The assembly process can be 
checked by using the STZ. 


The type of assembly position has a number of characteristic features 
from the viewpoint of using a robotic vision system. The assembly unit 
ordinarily consists of uniformly painted parts. Assembly is performed 
at the work position (assembly table, revolving table and so on), having 
a relief surface due to the presence of clamping devices, fasteners and 
other hardware. It is complicated to provide special lighting of the 
parts under production conditions. 


Thus, the image of the work position, obtained by using optical sensors 
(vidicons, CCD-arrays, and photoarrays), has the following 
characteristics: 


low contrast of individual parts and of their elements; 





low contrast of the images of the assembly unit and of the work 


position; 


nonuniform distribution of illumination due to selection of the local 
and general lighting system; 


fluctuation of the level of illumination over time; 


the presence of contrast interference on the image (contamination, 
highlights and so on). 


Moreover, the assembly unit has a complex structure, which leads to the 
appearance of structures from uniformly lighted regions embedded in each 
other on the image. 


Binary robotic vision systems, which have become widespread (the number 
of brightness gradations is equal to two), do not permit processing of 
scenes of this complexity. The use of binarization methods (both with 
fixed and with adaptive thresholds) and the preliminary processing step 
of the images requires uniformity and stability of lighting and high 
contrast between the “object” and "background." The resulting 
silhouette images contain only an insignificant part of the information 
about the scene. Thus, despite the low cost and high speed of binary 
robotic vision systems, the sphere of their application for automation 
of the assembly process is limited. 


This problem can be solved by using multigradation STZ (the number of 
brightness gradations is from 8-16 to 256 and above). A monochromatic 
half-tone image is subjected to various types of transformations 
(correction, improvement, filtration, segmentation and so on) at the 
preliminary processing step to intensify contrast, to compensate for 


noise and to distinguish its characteristic elements. 


\ large number of methods and algorithms for processing multigradation 
images has now been developed [1-3]. However, robotized assembly 
imposes a Significant restriction on the speed of the robotic vision 
system. All the processing steps from input of the image of the scene 
to recognition of it should occur within 1-3 s [1]. Therefore, many 
algorithms used with STZ to check assembly operations require 
development. of special high-speed hardware, which increases the cost of 


the system. 


Making a histogram of the image frame by brightness is most frequently 
used in industrial robotic vision systems for adaptation to variable 
lighting conditions. The threshold or interval of binarization is 
determined by the type of histogram, and the image is further processed 
the same as in binary STZ with adaptive threshold. This method is 
applicable for high-contrast images. The brightness distribution 
histogram for images of standard assembly units ordinarily has no 


Characteristic “dark” and “light” peaks, which does not permit one to 
determine with sufficient accuracy the binarization threshold. 





Gradient methods yield good results in the case of an absence of noise 
m the image [2]. But the low contrast results in disruption of the 
contour, approximation and connection of segments of which require large 
computer expenditures. Moreover, information is lost after calculation 
of any gradient function (Sobel or Roberts operator or something else), 
l.e., it becomes more difficult to determine to which of the parts it 
corresponds when determining the only the contour of parts. 


Studies of man’s visual perception system [4] indicate the psychological 
nature of perception of the illumination and color distribution 
function. The concept “BRIGHTNESS” is constructed on the basis of 
subjective impressions of man and is dependent on the total level of 
illumination of a scene, attention to its individual parts, and ona 
number of other factors. Determination of regions on an image, uniform 
in illumination, is one of the preliminary processing problems of 
multigradation images for robotic vision systems. Segmentation of 
images can be regarded as a problem of making a decision on the 
affiliation of the element of the image of some region to the level of 
illumination, typical for it. 


It is suggested that linguistic variables, constructed on the basis of 
odd set theory, be used to formalize the concept “BRIGHTNESS” [5]. From 
the mathematical viewpoint, the degree of the affiliation of the image 
wi € [0, 1] to the following odd set corresponds to the i-th element of 
an image with brightness code b, 


Ly = Han (Bj), (1) 


(b) is a function of the affiliation of the odd set. The key 


where Hon 
aspect is determination of the type of affiliation functions. Basic 
linguistic variables “LIGHT,” “GRAY,” and “DARK” were selected for the 
concept “BRIGHTNESS.” Based on analysis of expert estimates of 
brightness for separate areas of images of a number of assembly units 
and parts, it was determined that the affiliation functions have a 
nature close to quadratic (Figure 1). The concept "BRIGHTNESS" can be 
approximated by a context-free grammar, which is the set of four 
6 

G=<N, T(N), U,S a 
where N is the name of the linguistic variable, T(N) is the term-set of 
its values, U is the set of values of the basic variable, and S is the 
syntactic rult f formation of the linguistic variable. The structure 
f the grammar (2 s presented in Figure 2 
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Figure 1. Functions of Affiliation of Basic 
Linguistic Variables: 
—- + — --"LIGHT"; --"DARK", — — — --"'GRAY"” 





An alphabet of linguistic variables is formed by using the proposed 
grammar. The number of values of the variables is dependent on the 
postulated problem and should not exceed the Miller number 7 # 2, which 
expresses the maximum number of gradations of the parameter, 
Simultaneously stored in the human memory [4]. Expression (1) can be 
considered as one of the methods of improving images by conversion of 
the brightness scale. 


The result of conversion of the i-th element of the input image for the 
selected linguistic variable is determined by the formula 


b= Byrn (di), (3) 


where B is the numbt-r of brightness gradations. 


The “brightness cutoff" of the initial image is determined by using 
transformation (3). Adaptation to the dynamic range of brightness is 
made upon formation of the affiliation function Hab) for one or 


several image frames. If the linguistic variable "DARK" is used, the 
result of the transformation will be a more contrasting image, and if 
the “LIGHT” variable is used, the result will be an inverted contrast 
image. 


The image is segmented according to an alphabet of n linguistic 
variables. The k-th variable that corresponds to the maximum to it, for 
which the following condition is fulfilled 


i, = max pj (0;), at j=l, n. (4) 
j 


/ 


is then selected for each i-th element of the image. This linguistic 








variable is characterized by a brightness code By, and is calculated by 
the centroid method as the abscissa of the center of gravity of the 
figure, limited by the affiliation function [5]. 
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Figure 2. Structure of Grammar of Concept 








"BRIGHTNESS" 
KEY: 
1. Brightness 6. Vary 
2. Light 7. Lighter 
3. Gray 8. Darker 
4. Dark 9. More 
5. Not 10. Less 


The proposed algorithm for segmentation of multigradation images using 
odd linguistic variables satisfies the principles of the completeness, 
connectedness, homogeneity and other requirements, imposed on the 
segmentation process [1]. It can be used in the case of low-contrast 
images with contrast noise, under conditions of fluctuation and 
irregular distribution of the level of illumination, along with other 
preliminary processing algorithms. Segmentation of images measuring 
128 x 128 elements with 64 gradations of brightness yielded good 
results 


The advantages of the given algorithm, compared to other known 
algorithms, include the possibility of adaptation to variation of the 
conditions of illumination, greater information content of the resulting 
image, and high speed and simplicity of realization. The disadvantages 
may include some degree of subjectivism in selecting the type of 
affiliat ion functions and of the alphabet of linguistic variables as a 
function of the image. Studies of the possibility of automating this 
selection are now under way. 
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{lext] Use of the principles of associative data 
processing in the area of computer vision is 
considered. A method of realizing associative 
concepts for pattern recognition is proposed, which 
includes selection of the method of encoding the image 
contours of objects, and formation of the basic 
dictionaries of the most typical elements of a 
Silhouette image of an object. 


Recognizing the images of objects is a process of analyzing them on the 
basis of selected features and working out decision rules, which permits 
ne to relate each of the imaged objects to one of previously formulated 
classes according to a specific criterion. The theoretical methods of 
image recognition are based on two mathematical approaches: the 
discriminant and structure-linguistic [1]. 


Discriminant methods of recognition comprise the basis of the software 
f serially manufactured robotic vision systems (STZ), which are used 
successfully to analyze working scenes, containing isolated objects that 
have a limited number of stable equilibrium positions. Complication of 
the scenes and objects causes specific difficulties in the use of 
discriminant methods, since not only the numerical characteristics of 
the objects, but also information in terms of parts and relations that 
characterize their mutual location must be taken into account in these 
scenes. Structure-linguistic methods [2, 3], based on the structural 
relationships between “primitive” and their ordered combinations, 
rrespond to the greatest extent to this situation. 


However, despite a number of successful applications of structuie- 
linguistic methods [1], practical realization of their potential 








capabilities is now very low. This is explained by the following 
factor: specially developed methods of transforming physical objects to 
mathematical structures, convenient for using classification algorithms, 
do not yield a clear description of different objects [4]. In other 
words, different methods of structural description are required for 
different classes of objects. 


Thus, a central problem in structure recognition is development of a 
universal method of describing the shape of objects (within the limits 
of two-dimensional projections of three-dimensional objects) using the 
principles of associative representation of information, realized by 
associative memories. The use of dynamic associative memories (DAZU), 
which store the dynamics of input events, is of greatest interest. The 
distinguishing feature of DAZU is the capability to structure the input 
data. Let us briefly present the main aspects [5, 6]. 


Presentation of information in associative memory. The DAZU can be 
described by a network of parallel-connected neuron-like elements (NE) 
with time summation of input signals. A neuron-like element of this 
type (Figure 1) is a device containing a multibit shift register, 
threshold converter and memory element, and all the cells of the 
register, having exciting or inhibiting input, are connected. 
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Figure 1 


KEY’: 
1. Threshold element 2. Memory element 


The first part of the NE operates as an address part. A sequence of 
pulses, which can be interpreted as the sequence A = {aj:aj € (0, 1)) 
(the 0 means the absence and 1 means the presence of pulses during some 
time cycle i), is fed to the input of the neuron-like element. Symbol 
Aaj, arriving at moment i, is fed simultaneously to all cells of the 
shift register and is added to the contents of each cell with its own 
weight (41 or -1). The contents of the cells of the register are then 
shifted by one position to the right (according to Figure 1). The 
maximum sum stored in the last element of the register may reach a 
value, equal to the sum of the ones in the address, and this occurs only 
if the input sequence repeats the distribution of signs at the inputs of 
the register. 


The dynamic associative memory contains 2° neuron-like elements, each of 
which simulates one of the vertices of an n-dimensional single hypertube 
in the signal space. 
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The binary sequence A, the input sequence for the dynamic associative 
memory, is transformec to the n-dimensional address space in the form of 


a 


a sequence of points--trajectories A = F(A), from which the initial 


sequence A = F~!'(A) can be restored. Transform F has the property of 
associative access to the information by association with respect to 
content (to n symbols of the input sequence). The trajectory is stored 
by introducing the memory function H at the vertices of the hypercube 
(the next symbol of the sequence is stored). 


Allotment of function H by threshold properties permits one to realize 
statistical processing of the information stored in the dynamic 
associative memory, including formation of a dictionary of statistically 
reliable events {3} at the input of the DAZU in the form of a set of 
sequences {A}:{3} = F({A)}). 


Depending on the threshold of function H, the words {3} will either be a 
combination of trajectories of realizations of events (all the 
information is stored), or will be a diffuse or point intersection of 
them (a more or less general part of the information is allocated). The 
coinciding sections of the sequences--events--are transformed to the 
same chain, and different sections are transformed to different chains, 
thus forming the graph word. 


The information contained in dictionary {9} is eliminated from the input 
sequence by introduction of transform Poh only the connections of the 


words of the dictionary are retained in this case, and a syntactical 
sequence C = FL (F(a), {f}] is formed. The mechariism of formation of 


the syntactical sequence permits one to use the dynamic associative 
memory for structured data processing within the framework of the 
hierarchical structure from the DAZU, since it becomes possible to 
combine several data flows. 


Playback of the information using transform F~! permits recognition of 
the input sequence by comparing it to the reproduced sequence. 


Coding of input information sequence. The selected method of structured 
data processing is realized only by the presence of an active method of 
coding it, i.e., the input information should be described in the form 
of a sequence of codes. Thus, any information about the image, for 
example, contours that limit the zones of equal elimination or zones of 
identical texture, can be represented by this method. The external 
contour, a description of which is also selected for program realization 
of the proposed structured processing method, carries the basic 
information about the shape of the object. 


Among the methods of contour coding, used in computer vision, 
differential Freeman codes are most suitable for solution of the given 
problem, since the information about the contour in them is already 
represented in the form of a closed series of symbols. However, this is 
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inadequate, since coding for a dynamic associative memory should be 
binary (the permissible symbols are only zero and one) and position- 
independent. 


Fulfilling the first requirement permits considerable simplification of 
the methods of data processing in a dynamic associative memory, and 
fulfillment of the second requirement permits a significant increase of 
its operating reliability. 


The binary method proposed by the authors describes a straight line in 
the form of a sequence of alternating zeros and ones, a turn to the left 
in the form of a combination of two zeros, and a turn to the right in 
the form of a combination of two ones, according to Freeman coding. 


Formation of level-by-level dictionaries. The following sequence of 
writing information to the hierarchical structure of the dynamic 
associative memory has been suggested in the paper. Code sequences that 
describe a set of straight line segments are used as the elements of the 
lowest-level (first-level) dictionary. The arc of circles of different 
radius are included in the dictionary of the second level. The 
dictionary of the third level contains information about different 
angles. This representation is explained by the fact that the 
statistically more reliable elements of objects (straight-line 
fragments) are primarily allocated, then the less reliable (arcs of 
circles) and, finally, more variative (angles) are then allocated. The 
proposed representation can also be interpreted in terms of 
two-dimensional orthogonal transforms, where the process of detailing 
the description proceeds from the lower to the higher harmonics. 


To study the processes occurring in the dynamic associative memory and 
the methods of structured processing of visual data, the authors 
developed a research complex that includes: 


a machine graphics program package for synthesis of the images; 


an image preprocessing program package that converts silhouette images 
of objects to contour descriptions (in the form of Freeman catenary 
codes) ; 


a program for recoding a catenary code to a binary code; 
a program model of the DAZU; 


a program for visualization of the trajectories written in the dynamic 
associative memory. 


The complexity of transforming the trajectories in an n-dimensional 
signal space to a two-dimensional visualization plane was the reason for 
representing the graph of trajectory transitions in the DAZU in the form 
of a tree, in which branching of the trajectory in the signal space is 
depicted in the form of a fork, while the fusion of two trajectories 
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into one is depicted in form of the end of the branch of the tree. 
Continuation of the trajectory coincides with one of the points of the 
tree. The branching nature of the tree qualitatively reflects the 
degree of complexity of the graph. Thus, if the graph has no 
intersections (the degenerate case), its representation will be a 
straight line. 
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Figure 2 


An example of teaching the DAZU is presented in Figure 2, where 2, a is 
a synthesized silhouette image of the object, and also its contour 
representation in binary code (A is the initial point), and 2, b is the 


internal represent* ‘ .n the form of a binary tree. 
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[Text] A robotic vision system has been proposed for 
checking the shape of semiconductor crystals, realized 
on the universal Elektronika-60 microcomputer. A 
functional diagram of the visual system is described. 
Algorithms for operation of the system and its 
specifications are presented. 


Much attention is now being devoted to development of robotic vision 
systems (STZ), designed to automate product checking operations of the 
electronics industry (semiconducting crystals and plates). One of the 
methods of realizing STZ is to develop these systems on the basis of 
universal microcomputers [1-3], the stock of which contains a large 
number of various types of machines. 


The robotic vision systems now developed on the basis of universal 
microcomputers ere either cumbersome and expensive (made in the CAMAC 
design) [1], are inconvenient to service (there is no visual check of 
the images to be analyzed) [3], or are incapable of remembering the 
necessary number of reference images, and can not be connected to a 
computer network [2]. 


The robotic vision system described in the article, designed for 
automatic quality control of manufacture of semiconducting crystals 
(check of the conformity of the shape (design) to a standard and of the 
presence of mechanical damage (scratches)), does not have the indicated 
deficiencies. An Elektronika-60 microcomputer is used as the control 
computer in the robotic vision system. An Electronika MS0585 or 
Elektronika MS1212 microcomputer can also be used in the STZ. 
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A functional diagram of the robotic vision system is presented in the 
Figure. The STZ consists of the following devices: an optical 
microscope (M), television camera (TK), buffer storage (BZU), 
programmable ROM (PPZU), electronic disk (ED), long-range communication 
module (BDS), an inter: ice (I), a controlled power source (UIP), a key 
module (BK), lighting module (BO), color monitor contro] module (MUTsM), 
a color monitor (TsM), black-white monitor (ChBM) and a computer. The 
optical connections are shown on the diagram by dashed lines, while 
electric connections are shown by solid lines. 


KEY: 
1. Optical microscope 8. Electronic disk 
2. Television camera 9. PROM 
3. Buffer storage 10. Interface 
4. Black-white monitor 11. Conrtrolled power supply 
5. Color monitor 12. Key module 
6. Microcomputer 13. Lighting module 
7. Color monitor control module 14. Long-range communication 
module 


The total operating cycle of the STZ contains two steps: teaching 
(writing the image of the reference obyect to the memory) and operation 
(obtaining the necessary data on the object to be checked). The 
teaching step can be fulfilled either by writing the information to the 
memory of the STZ (to the electronic disk) by direct reading of the 
image of the reference object, or by recording the reference information 
(to the electronic disk or PROM) by program. The first method of 
teaching is used in the STZ, which begins with establishement of the 
necessary lighting, provided by the interface (a I-2 device), controlled 
power source, key module, and lighting module (assembled on light diodes 
of type ALIO7A) in the working zone of the micros:-ope (of type PME-1 or 
MBS-9). The Light module contaius different numbers of light sources, 
the iight intensity, operating frequency and frequency of switching-on 
of which are established from the computer. The Light sources are 
arranged about the control object (crystal). An image of the crystal in 
the working zone of the microscope is perceived by the television 
camera, is read (written) to the buffer storage, which stores one frame 
of the image measuring 256 « 256 and 16 brightness gradations (64K 
four-bit words). The reference image is then copied to the electronic 
disk (with capacity of 2,000 kbits), which stores eight frames of the 
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images. The image is processed (filtered or segmented) when the 
reference infcrmation is written to the electronic disk according to the 
algorithms described below. This permits one to present a higher 
quality image and to enhance considerably the accuracy and operat ing 
speed of the STZ. The process of teaching the STZ terminates at this 
point. The STZ program, developed in Assembler language, is written to 
the programmable ROM. Communications are established through the common 
bus of the robotic vision system and central computer by using the 
long-range communication module (of the BDS-60 type), which permits one 
to provide problems of simulation of the operating algorithms of the STZ 


or program support of the STZ if necessary. A local data transfer net 
is used for this. The original devices of the STZ are the buffer 
storage and electronic disk. 


The buffer storage operates in the following modes: writing the image 
frame from the television camera to the memory module (BP) with a 
simultaneous check of the image introduced to the black-white monitor, 
reading the information from the memory module to the computer, and 
writing the information from the computer to the memory module (to check 
the processed image) to the computer. The buffer storage is embedded in 
the design of the microcomputer and occupies one complete card. The 
memory module of the buffer storage is realized on 16 565RUZ 
microcircuits. 


The electronic disk operates in the following modes: writing 
information from the microcomputer, regeneration, and reading the 
information to the microcomputer. In the write mode, the electronic 
disk generates all the necessary signals for storage of the line and 
column addresses in the internal registers of the memory microcircuits, 
and also for writing of data to the corresponding group of 
microcircuits. After the write cycle is completed, the electronic disk 
switches to the regeneration mode, which is achieved by accessing each 
of 256 lines of all frames at a speed of 2-10°* s. The read mode is 
similar to the write mode and is controlled from the computer. The 
electronic disk is structurally made in the microcomputer standard (one 
half-height card). The main memory of the electronic disk is assembled 
on 32 565RU5 microcircuits. 


The software of the robotic vision system permits the operations of 
checking semiconducting crystals or plates: estimating the correctness 
of shape (arrangement of the structural components of the crystal), 
measurement of the geometric characteristics (area, linear dimensions, 
for example, length and width, and perimeter of the contour), and 
determination of the mechanical damage (the presence and dimensions of 
chips and scratches). 


One operating cycle of the STZ consists f the following steps: 


determination of the boundaries (the distance of the eiges) of the image 
frame ; 
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preliminary processing of the image; 
removal of the necessary information. 


The boundaries of the image are determined, achieved by eliminating the 
distortions on the edges of the image frame, in the first step of 
functioning of the robotic vision system. In the second step of 
operation of the STZ, the contours of the image are filtered and 
determined. The filtering operation is used to remove noise, 
interference and distortions of the images, which occur due to 
imperfection of the hardware and due to the process of formation of the 
image. This operation is achieved by one of three methods: by the 
threshold method, by low-frequency filtration or by median filtration 
[4]. The threshold method is based on measuring the brightness of all 
the elements of the image, on comparing this brightness to the mean 
brightness of adjacent elements of the image, and on replacing the 
measured brightness by the mean brightness. Low-frequency filtration is 
achieved by reducing the initial image file with the correcting file. 
Such methods of filtration as a window in three or five elements, a 
cross in five or nine elements, and the weighted mean (along the 
vertical or horizontal sequentially) in three or five elements are used 
with median filtration. 


The operation of discrimination of contours is based on the use of one 
of the following methods [4, 5]: of a differential Roberts or Sobel 
operator, of a logarithmic Walsh detector, of formation of the contour 
by analysis of four or eight adjacent points of the image. 


Selection of the filtration method and of discrimination of contours is 
determined by the geometric and light characteristics of the crystal, 
and by the required speed and operating accuracy of the robotic vision 
system. 


\]l the necessary measurements of the visible upper plane of the crystal 
are made on the third operating step of the robotic vision system. The 
algorithms of the STZ, which realizes the method of comparison to a 
standard, consists of the following operations: “review” of the crystal 
plane, measurement of the length, width, perimeter, area and angles, 
determination of the correctness of the ratio of the design (for 
example, displacement of the contact surface from the center of the 
surface of the crystal), and estimation of the presence and value of the 
area of chips and scratches of the crystal. A reference file, 
formulated during teaching of the robotic vision system, is used to 
analyze the geometric characteristics. Estimation of crystal defects is 
based on the correlation method of comparison of images [5]. 


The following characteristics were obtained when testing the robotic 
Vision system: resolution of 0.2 percent of the size of the image frame 
(for example, the resolution is no worse than 100 gm at frame size of 

") 


25 « 25 mm, the accuracy of estimating the linear dimensions (total) is 
random (mean square deviation) and systematic, which comprise a 
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measurement error of 0.1 percent of the size of the image frame at 
checked size of the crystal (0.3 x 0.3)10-? m, and the time of checking 
one crystal of 0.1-10 s as a function of the required measurements and 
complexity of the shape of the crystal. The described variant of the 
robotic vision system is being operated successfully at TIASUR [not 
further identified) and at other USSR enterprises. The cost of the STZ 
(including the computer) is approximately 13,000 rubles. 


Thus, the described robotic vision system is less expensive and is 
?istinguished from known systems [1-3] by better characteristics due to 
the capability of storing a sufficient number of reference images, due 
to connection of the STZ to a computer network, and due to convenience 
of servicing because of selecting the image on black-white or color 
monitors. 
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[Text] The working and operating principle of a fiber 
sorption muscle and the structure of a one-step drive 
system are considered. The law of control of the 
drive is synthesized. Promising areas of using the 
module are indicated. 


There are now two parallel creative processes. One is related to the 
evolutionary development of nature, unobtrusive in daily life, and is 
the original fiber universality of the muscular-receptor development of 
organisms. The other is more dynamic and is expressed in the results of 
the technical activity of man. The observed attenuation of the uniting 
mutually enriching bionic approach in the engineering of machines, 
mechanisms and, specifically, of robots and manipulators, is explained 
by the absence of satisfactory analogues of muscles, receptors and so 
on, which are possibly the key linking elements for the compatibility of 
the natural and technical approaches. The particularly theoretical 
papers on development of bionic approaches acquired the form of specific 
technical developments with synthesis of the world’s first fiber 
sorption electronic muscle in the Soviet Union in 1988. 


The main elements of a one-step controlled module are kinematic 
anthropomorphic links and an antagonistic pair of fiber sorption 
muscles. A layout of the working principle of the muscle is presented 
in Figure 1. It contains a cord of an anisotropic sheathing 1 in the 
form of a hollow cylindrical cord, inside which there is a closed 
elastomeric space 2. Adsorbent-adsorbent fillers 3 and 4 are located in 
this space. The adsorbent 3 is at the same time a thermocoupie. 
Electric contacts 5 and 6 are hermetically led to the outside from the 
opposite ends of the sheathing 1. The surface of the adsorbent 3 is 
heated due to the effect of electric current delivered to contacts 5 and 
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6. As a result, the adsorbate 4 leaves the surface of the adsorbent 3, 
switching 2 vaporous state. The pressure in the elastomeric space 
Ss increased. The filaments in the internodes of the anisotropi 
sheathing 1 are rotated and the muscle is contracted. If the current is 
by convection or preventively, 
axl the adsorbate 4 is adsorbed due to reversibility. The pressure 
drops and the muscle does not prevent its own lengthening. Thus, the 
force developed by the muscle is determined in the final analysis by the 
pressure of the adsorbate. 


> 


switched off, the adsorbent 3 is cooled 


Two main elements can be distinguished in the muscle unit: a 
micromechanism of a sheathing force converter and a sorption 
microengine. The sheathing transforms the internal energy of the quscle 
to force contraction. 


Studies of the parameters of the cord | revealed a specific dependence 
of the maximum value of the relative longitudinal deformation on the 
nature of representation of braiding of the sheathing. Specifically, 
the following calculating function is valid for braided sheathing: 


> 


where e. is the derformation of the braided cord of the muscle, @ is the 


angle in the internodes of the braiding of rhombic elementary cells, 
is the width of the initial filament, and hy is the length of the side 


of the rhombus of the elementary cells of the cord. 


For bound sheathing, the length of the edge seemingly increases by 
approximately the width of the filament which is oriented from above, 
while the value of the internodes becomes twofold greater than that in 
braided sheathing. On this basis, a similar function is 


The maximum angles in the internodes of the rhombic cell of the cord 
layer of the muscle sheathing were established 


54 Sart 


The principles that link the pressure inside the muscle in the stati 
made to the deformations and forces developed by it in the absence of an 


external load are expressed by the formula 
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where hy is the thickness of the elastomeric volume of the guscle, x is 


the relative variation of the length of the muscle (specific length), E 
is the modulus of elasticity of the material of the elastomeric volume 
of the muscle, and r> is the external radius of the elastomeric volume 
of the muscle. 


The force developed by the muscles is related only to compressive 
strain. Therefore, the external load on it has physical meaning 
exclusively in the direction of the tension of its sheathing. The 
dependence of the steady internal pressure Gp on the external load P on 


the muscle is derived. The values of q and Ip according to the 
principle of superposition, determined the total internal pressure 


jz =O Op. (5) 


where 


. : ° - 6 
gp= P sin? amin{ (1—x? cos? Gin) 2717) ". (6) 


Here r; is the internal radius of the elastomeric volume of the muscle. 


Figure 1. Working Principle of Electronic Muscle: 


l--cord of anisotropic sheathing; 2--closed elastomeric 
volume; 3--adsorbent; 4--adsorbate; 5, 6--electric contacts 


The mechanisms presented by formulas (1)-(6), which in combination 
permit numerical-step variation of the main parameters, specifically 
permitted calculation of the sheathing of the first electronic muscle. 


Reversible sorption microengines in electronic muscles essentially 
perform the role of direct converter of electric energy to mechanical 
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energy. Adsorption-desorption equilibrium is in the given case the 
initial physical phenomenon. It is expressed in regulated concentration 
of materials on the surface or of solid micropores in the volume. 

Matter of the solid phase, on which the material to be absorbed is 
concentrated, is called the absorbent. The materiai to be absorbed, 
present in the gaseous phase outside the adsorbent, is called the 
adsorbtive, while its part directly concentrated on this surface or in 
the pores is called the adsorbate. Construction of the sorption 
microengine is closely related to the concept on micropores as on the 
regions of space in a solid, comparable in dimensions to the adsorbed 
molecules. The field of the adsorption space includes three types of 
interactions in the given case. The main interaction is dispersion, 
manifested between nonpolar molecules. The electrons move in a complex 
manner about nuclei in atoms and molecules. The dipole moments of 
nonpolar molecules over average time are equal to zero, but the 
instantaneous value of the dipole moment may be distinct from zero. The 
instantaneous dipole creates an electric field, which polarizes adjacent 
molecules. As a result, there is interaction of the instantaneous 
dipoles. The energy of interaction of nonpolar molecules is the mean 
result of interaction of these instantaneous dipoles. In physics, 
forces of this class of interaction are called London forces. A common 
nature distinguishes them--they can occur between any atoms and 
molecules, by which their universality is also explained. An 
orientation effect, caused by dipole-dipole interaction due to the 
effect of Keesom forces, occurs in the presence of constant dipoles in 
the molecules of the adsorbate. Intermediate between the dispersion and 
lipole-dipole type of interaction is the induction effect, which is 
manifested between the polar and nonpolar molecules under the effect of 
Debye forces. London, Keesom and Debye forces are mutual attractive 
forces. Determination of the energy parameters of electronic muscles of 
fiber-sorption type is semi-empirical in nature. An adsorption isotherm 
is initially constructed for the selected type of adsorbate-adsorbate 
filler of the electronic muscle in the form 


B=f(q) «t T=const, 


one of the experimental variants of which is presented in Figure 2. 


The work of adsorption A, equal to the differential variation of the 
Gibbs adsorption energy, taken with opposite sign 


A=—AG=RTIn(q.q7'), (7) 


where R is the universal gas constant, T is the absolute temperature, 
and qs is the tabular value of the saturated vapor pressure above the 
liquid adsorbate, is then determined. The corresponding qo and To, and 
also the differential molar work, which expresses the characteristic 
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adsorption energy Bo, are found in the absence of adsorbent at 
temperature T. The maximum adsorption for temperature To is determined 


by the equation 


Bo= Bo, exp[—y(T—T,)], 


here 7 is the thermal coefficient of maximum adsorption. 











Figure 2. Experimental Isosteres for Different 
Fractions of Filling of Volume of Adsorbate-Adsorbent 
System of Electronic Muscle: 

V--volume of pores of adsorbent; Vo--total volume 








Figure 3. One-Step Drive System, Containing 
Antagonistic Pair of Electronic Muscles 


KEY: 
1. Controller 4. Position sensor of output 
2. Amplifier element of drive 
3. Muscle 5. Computer of difference of 


mean and instantaneous power 
of heating of muscle 
adsorbents 
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Substituting the calculated values of Bs and Ap» into the thermal 
equation of Dubinin-Astakhov adsorption 





B = B,exp -( aT ates) ). 


the adsorption isotherms are calculated for a number of values T, lying 
in the temperature range of practical interest. The graphs of the 
adsorption isosteres are then constructed, i.e., functions of the 
following type are constructed 


g=f,(T) - B,=const. 


Adsorption increases as the pressure of the adsorbtive increases. The 
differential work on a background of an increase of absorption with an 
increase of the pressure of the adsorbtive decreases. The thermodynamic 
state of the electronic muscle is expressed by adsorption-desorption 
equilibrium between the adsorbate and adsorbtive, which, as in the 
classical variant of a heat engine, is determined by three values: 
pressure, temperature and the volume of the working gas. The difference 
is only that the volume in the given case has adsorption properties 7. 
Differential variation of entropy can be expressed by finding the 
differential of 4G by temperature: 





, (8) 





——Rin (qq) — RT (SE) + are 


The direct derivative is correctly written in the last term, since q, is 
independent of adsorption B. Let us find the differential variation of 
enthalpy, having substituted into the equation 


AH=AG+TAS 


the corresponding expressions from equations (7) and (8): 





. 1 “1) 
dH = — RT in(9,q°') — RT in (9.4 ')- RT| “oF = (9) 
din din qs 
= RT(-Gp%) — RT ap 
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The first term of the right side of equation (9) expresses the 
differential heat of adsorption of the adsorbent, while the second term 
corresponds to the heat of condensation of the adsorbtive. Thus, 
construction of isos-eres is used to calculate the differential entropy 
and differential enthalpy of the sorption microengine of the electronic 
muscle. 


If there is no external interactive force, the length of the muscle is 
dependent cn its internal thermodynamic state. Without regard to 
thermal losses, it is characterized by the mean power of the heating of 
the adsorbent 


1 r ’ 
Nem 2 \ Nas, (10) 


where N = I’r is the instantaneous heating power, I is the electric 
current in the adsorbent, r is the resistance to current, and fT; is 
time. 


If the given contraction of the muscle was established, one can in the 
first approximation permit a link between length l, and power: 


1,=KN-+h, 


lo is the length of the muscle at Po = 0 and K, is a coefficient 
determined experimentally. The steady force P,,, developed by the 


muscle, is represented by the formula 


Py = Kz(1,—!) = Kz(K,N.+h—1), 


in which 1 is the length of the muscle deformed from outside and K, is 
the longitudinal stiffness coefficient. With regard to (10), we find 


Pa=K,( Ke | ay +4!) 


The structure of a one-step drive system, containing an antagonistic 
pair of muscles, is shown in Figure 3: ™; and Mo are the muscles, U is 
an amplifier, UU is the controller, DP is the position sensor of the 
output element of the drive, and VM is a computer of the difference of 
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the mean and instantaneous power of heating of the adsorbents of the 
muscles. 


For an antagonistic pair of muscles in the steady state, the forces 
developed by them are equal to 


P,=K, (Kt \id,+h— 1) 
0 
Pro Ke [Ke | Hida +h -_ ts] ' 


here I; and I» are currents of the first and second muscles and 1, and 
l» are their lengths. Let us assume that lo - 1; = ly lo - lo = In, 


lL, @ 0 are the position of the output element of the drive. The values 
1. = 0 and 1, = le = lo correspond to the off state of the pair of 


n 
muscles. 


The force of drive P is equal to the difference of forces P; and Pp», 
acting oppositely. In the steady state 


Poa KK) (f—1)d:,— 2,| 


In the transient process from the initial (unheated) state of the 
muscle, P is calculated by the equation 


poi= | K rf t= a — 2h], (11) 


where 7 = T; = To is the time, as a function of which fcrce P developed 
by the drive with time delay varies, and ry is the time delay in the 
appearance of force, corresponding to the difference of the mean heating 
power of the adsorbents of the muscles and to the position of the output 
element of the drive ly at moment of time r;. 


In (11), dt=dt;; f,=1,(t), lo=J2it), l,=l,(t). The forces of currents I; 


and I> are related to the value of signal U,; at the input of the 
amplifier 


I= KyU whi; [p= KyUgtda, 
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where Ky is the transfer coefficient of the direct channel of the drive, 
A, is a coefficient equal to unity at Us; > 0 and equal to zero at Us; < 
€0; 42 = 1- A. 


Let us substantiate the law of control Us;, realized in the controller 
(UU). The signal U; (Figure 3) corresponds to a given position of the 
output element of the drive 1,, i.e., to the positions of the mechanical 
link Le = Kl at Kk = const. 


The different processes of the tasks U,(7r) are found, having minimized 
by function 1 (9) the following functional, known in optimal] control 


theory 


T= $'[ (lola) ?+ Ke (lela) ede, (12) 


Then varying the value of coefficient K,- Here l, = lg(r) and 1,'!’(r) 
are given functions, and [,'!)(t) =dl,/dt, In'(t) wdis/dt. Tf t-> oo, L—i, +0, 
LO—{,0——0, the necessary condition of a minimum of (12) will be an 
Euler equation [2] 


log + VRe (le —Lq("”) =(. (13) 


Let us find the relationship of the speed of the output element of the 
drive ff to power Na and Nao’ To do this, let us first assume that 
there is no longitudinal deformation of the muscle by external force Pi: 


This means that the force of the drive P is equal to zero. Then 


ty (ree SE (RT) te 


Having differentiated 1,(7) by variable +r, we find the desired function 


i () = Ng — Nas) . (14) 


in which Ny= (J 2—34)r is the instantaneous power and Nae= =] Ui 
- Ig*)dr is the mean power. For the position mode of development of the 
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task U;(r), let us assume that derivative 1,'!'’(1r) is equal to zero. 
After substitution of (14) into (13), we find 


= (l, — b,) + YX (ww, — Nv) =O. (15) 


The relation le - ly 
the difference Nae - Na can be disregarded. 


is insignificant at small values of r. If r <a, 


The law of control of the drive is derived by combining (15) with the 
equation of motion of the output element of the drive 


ml, = P—Pw, 


where m is the reduced mass of the structural elements, displaced by the 


drive, P. is the force of resistance to the drive, and P is the force of 


the drive in the transient process. However, if the indicated equations 
are combined, we arrive at a control law U,;, to realize which is it 
possible only by having determined Py and time derivatives of La This 


is very difficult in practical realization. 


The approach to control of the drive using only an Buler equation, valid 
at Py = 0, appears more rational. In this case, the law of control is 


formulated so ‘hat the drive system approaches the state described by 
equation (15) at each moment of time r. Let us assume that this 
equation is not exactly observed. Then either a positive or negative 
value is found in its right side. In both cases, the right side 
approaches zero, if the control signal is sufficiently large in absolute 
value |U,;|, and its polarity corresponds to the direction of 
development. 


Let us introduce into consideration the control law 
Ua= { F(o)ds, 


where o=1,(/,—/,) + UR We—Na), i.e., of the left side of equation 


(15); variable r is replaced by rT, = const, 7, is the time segment, on 


which the transient process of operation of the drive essentially ends 
with given accuracy, Fig) =U > 0 at ¢> 0, Fie) =U <O0Oate< od, 
F(¢) = 0 at ¢ = 0, and |U| = const. 
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Replacing + by constant T, means that increased sensitivity to the 


difference of lengths Le - ly is given to the drive systen. 


Implementation of the integral control law U,,(7) creates smoothness in 
development of the task by the drive system and contributes to 
elimination of autooscillations in the steady process. For direct 
adjustment of the drive, it is recommended that the proposed control law 
be used in the form 


Uw= {Udr at o=i,—l,+K(No-—N,)>0: 


s 


Le=f(—U)dt at o<0; (16) 
0 





Un [0dr at o=(0, 


LU =const>0. 


Adjustment of the drive reduces to finding coefficient K. 


Let us assume that U,,, after integration, reaches saturation UL > 0 at 


¢ > 0 and - - ln < 0 and that it satisfies the condition Na < Nae’ a 


then increases due to the appearance of a large difference of the 
intensities of currents I; and I2. As a result, La which approaches 


l,, increases with a delay of +r. The difference INnc - NOI and 
jl. - 7 decreases in absolute value and ¢ approaches zero. Initially 
¢ = 0 at some small value of ji’. - Lt and then ¢ <0. The process of 


a decrease U,; begins, and a decrease of power N_ correspoixds to this. 


n 
Thus, power Nac will increase on the final section of the transient 
process when ln - ly and No will decrease due to a decrease of U,;. As 
a result, Nac . Na - 0, and ¢- 0. At the end of the process, in the 
stable system, Nac > Na Use = const, and lL. = La: The transient 
process should proceed in similar fashion if fr = 0 and ¢ < 0 and Le - 
- ly < 0. 


One can judge the stability of the drive by equation (16). Let us 
assume that the mean power Nac does not vary significantly during the 


transient process, a delay occurs after moment of time fr = to. 
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The equation of dynamics 


2K 2i.+ mi. D= K cK, K,U*,.—Pw 


will then have the solution 











P Kirk . {ORK 
tom [Se — 5% v4 + 4,00] 000 / Se + 
. 2K, 2 “ | = (17) 
Kirk yp Pe 
2 2K, 


It follows from (17) that the system is stable, but autooscillations are 
possible. The delay ‘o almost disappears for adequately heated muscles. 
Each muscle approximates an aperiodic link. The controller changes U,;, 
maintaining the equality ly = l.. The amplitude of the autooscillations 


of heated muscles reduces to a minimum or disappears by selecting 
coefficient K in formula (16). 
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Figure 4. Experimental Curves of Transient Processes 
L,fr) of Drive: 


l--process of development of task at P. = 0.6 N and at 


initial weakened state of muscles; 2--similar process 
at P. = 1 N; 3--process of development of task by heated 


muscles at Py = 1N 


The experimental curves of the transient processes Lin) of the drive 
are presented in Figure 4. 
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Drives based on fiber-sorption muscles with range of developed forces 
from 0 to 40 N have been manufactured since 1990. The efficiency cf the 
first models of their drive is approximately | percent. The time 
constant of the drive for unheated muscles in the initial state, 
considered as an aperiodic link (without delay), is at the level of 

30 s. Work is now under way to increase the speed of the muscles and of 
their efficiency. 
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[Text] The construction and design principles of 
multioutput actuating modules with several independent 
linear and angular motions are considered. A 
simulation model of a two-output actuating module, 
designed on the basis of Petri nets, is presented. 


When developing industrial robots and manipulators, it is necessary to 
ensure simplicity of design and minimum values of mass-size indicators 
[1, 2]. One of the methods of solving this problem is the use of 
multioutput actuating modules (MIM) in the actuating subsystem of the 
robot, which permit one to produce a set of independent linear and 
angular motions at the output. MIM can be located directly in the 
joints of the structural layout of the robot or on a fixed base. 


The design principle of the multioutput actuating module is based on 
suppiying the moving parts of the motor with couplings, controlled 
separately from the controller [3]. A generalized block diagram of the 
MIM is presented in Figure 1. The MIM includes a controller, 
reciprocating motor, 2n (nm 2 2) working couplings, n fixing couplings, 
mechanically connected to the reciprocating motor, linking elements, 
made in the form of nonmagnetic rods and flexible cables, and 
transforming members, made in the form of pulleys connected to the 
moving links of the robots. 
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Figure 1. Generalized Block Diagram of Multioutput 
Actuating Module: 
UU--controller; DVPD--reciprocating motor; EKS--fastening 
and joining elements; M--couplings; SPR--degrees of 
freedom of robot; PO--converting member; DP--position sensor 


KEY : 
1. Multioutput actuating module 4. Fastening and joining 
2. Position sensor elements 
3. Controller 5. Couplings 


6. Degrees of freedom of robot 


The controller controls the reciprocating motor, 2n working and n fixing 
couplings, and is connected to the robot’s control system. The 
reciprocating motor can be based on electromagnets or pneumatic and 
hydraulic cylinders or other similar devices, and is used to ensure 
reciprocating motion of the working couplings. The working and fixing 
couplings are controlled separately from the controller and transmit 
reciprocating motions through the linking elements either directly or 
through transforming membe, - to the movable links of the robot. The 
designs, shapes, dimensions and operating principles of the working and 
fixing couplings are dependent on the shapes, dimensions and materials 
of the linking elements, where the latter are used to transmit the 
motions of the couplings to the degrees of freedom of the robot and are 
different shafts, rods, and flexible elements (cables). 


The linking elements and together with them the corresponding 
electromagnetic couplings can be located on the outside, inside, or a 
combination as a function of the kinematic layout of the MIM and the 
mutual spatial arrangement of the degrees of freedom of the robot. 


The transforming member is used to convert the linear motions of the 
elements and is kinematically connected to the moving links of the robot 
manipulator. 


The multioutput actuating module operates in the following manner. 
Producing several angular and linear motions is based on conversion of 
reciprocating motions of two moving parts, moving in the opposite 
direction in n (n > 2) independent linear and angular motions of the 
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rods and cables by alternately switching the groups of 2n working and n 
fixing couplings on and off, controlled separately for each independent 


motion. The functions of converting X to x, (i = 1, n) are established 
by the laws of variation of the signals of the controller U;, Us, ..., 
U, over time. 


As a result, the reciprocating motions of the reciprocating motor are 
transformed to a combination of linear (x;, x2, ..-., x1), and angular 
(@jets @le2» «++» @,) motions, which are transmitted by transfer 
mechanisms to the moving links of the robot manipulator or of the 
robotic complex (RTK). 


The controller of the MIM is based on a microprocessor complex of series 
K580 and generates contro! signals for the reciprocating motor and 
windings of the electromagnetic couplings according to a given 
algorithm. The control algorithm of the MIM is based on the phase 
engagement method, which permits uniform variation of the dynamic force. 
The controller of the multioutput actuating module is linked to the 


control system of the robot and generates control signals [ = (U,, Us, 
.» Up) according to deviation of the given values of vector q3 from 


the actual values of % 


Petri nets, which are distinguished by clearness of the model in 
combination with rather broad functional capabilities, have been used 
extensively of late among the set of simulation models, oriented toward 
solution of various problems of simulation, analysis and synthesis of 
processes of different physical nature. 


The Petri net (SP) is formally determined as a set of five of type [4] 
S= <P, T, 1, O, we. {1) 


where P, T, I, and O are finite sets of transitions (events), positions, 
input positions, and output positions, respectively, go is the initial 
marking, and g3:P - N, N= (0, 1, 2, ...}) is @ set of natural numbers. 


Problems of design of simulation mode!s of multioutput actuating modules 
of robots and robotic systems are considered in the paper on the basis 
of the apparatus of expanded Petri nets, designed for description and 
analysis of the functioning of the latter. 
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Figure 2. Multioutput Actuating Module With 
Two Degrees of Freedom 


KEY : 
1. Multioutput actuating module 


A multioutput actuating module of the electromagnetic type, designed for 
horizontal and vertical motions in the structure of the robot or robotic 
system, is simulated. The MIM includes an electromagnetic module with 
movable elements, a coupling module, specifically electromagnetic 
couplings, which are divided into working and fixing, depending on the 
functivaal designation in the MIM, a controller and output rods. 


Let us consider the design step of the interpreted Petri nets on the 
example of a multioutput actuating module with two degrees of freedom 
(Figure 2). One degree of freedom is realized by using a rod I, which 
performs horizontal displacement to the left (to the right), and the 
second degree of freedom is realized by using a flexible rod II (or 
cable), which performs vertical motions downward (upward). 


The positions of the rods are fixed along the vertical and horizontal by 
using position sensors in coordinates Yl, Y2 and X1, X2, respectively. 
One of the variants of the model that describes the functioning of the 
multioutput actuating module is the Petri net, shown in Figure 3. 


Positions 1 and 2 describe the starting conditions of the electromagnets 
of the MIM, 3, 4, and 5, 6 reflect the states of these electromagnets, 
7, 8 and 9, 10 reflect the states of the couplings which are rigidly 
connected to the moving elements, 11 and 12 are introduced to simulate 
the processes of control of the electromagnetic couplings, 13 and 14 
reflect the state of the output rod, 15-17 are used to simulate the 
processes of control of the motor with regard ot the information of the 
position sensor, and 18 simulates stopping of the rod. Transition t,; 
reflects the process of variation of the state of the electromagnet, 
transition t» reflects the condition of connecting the coupling, tz; 
means transition of the coupling from one state to another, and t, 
reflects transition of the rod from one position to another. 
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Figure 3. Simulation Model of Multioutput 
Actuating Module 


The presence of markers at positions 13 and 14 denote the response of 
the sensor at position X1, and the presence of markers at positions 15 
and 16 denote a response of the sensor at position X2. The marker at 
position 17 denotes response of the sensor at position of either X1 or 
X¥2, while a marker at positions 4 and 5 denotes motion to the left or to 
the right, respectively. The delay time of the marker, equal to the 
time of displacements between extreme positions, corresponds to these 
positions. Let the markers be located at positions 15-17. The 
electromagnets of the multioutput actuating module can be started only 
after a marker appears at position 1. Upon response of transition t;, a 
marker appears at position 4, which means motion of the movable element 
to the left. Markers arrive at positions 13, 14, and 17 after response 
f transitions te, ts, and ts. The resulting marking is the initial 
marking for motion of the rod to the right. 





The work of the second output of the multioutput actuating module can 
also be simulated by a Petri net, presented in Figure 3. In this case, 


positions T, 3, 4, 7, 8, 13, and 14 simulate the motion of the output 
rod downward, while positions 2, 5, 6, 9, 10, 15, and 16 simulate motion 


f the output rod downward. 


The resulting Petri net of the multioutput actuating module is formally 
described in the following manner: 


P= {P,, P>,..., Pis}, T= {t,, Pr ecces to}; 
I (t;) ={P,, Ps, Ps, Py}, O(t;) = {P,}; 

I (tz) = {Ps}, Ofte) = {Pi}, 7(ts) = {Pi, Pi}; 
O(ts) = {Ps}, L(t) = {Pe}, O(ts) ={Pis, Pia, Pir}; 
I (ts) = {P2, Ps, Pig}, O(ts) = {Pe}, 1(te) = {Po}; 
I(t) ={Po, Pir}, O(ts) = (Pid; 

1 (tg) = {Pio}, O(ts) = {Pis, Pie, Pir}; 
I (ts) = {Pio}, O (ts) = {Ps}. 
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New designs of electromagnetic and pneumatic multioutput actuating 
modules, used as the actuating members of robots and robotic complexes, 
have been proposed on the basis of the generalized block diagram of MIM. 
The proposed designs are distinguished from existing robot drives by 
simplicity of design and minimal mass-size indicators. 


The structural layouts of industrial robots, operating in different 
coordinate systems, have been worked out on the basis of multioutput 
actuating modules. The proposed designs of MIM can be used in 
construction of the actuating members of adaptive robots, robotic 
complexes, and of systems of different designation. 
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